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ABSTRACT 


This  report  describes  the  work  completed  under  AFOSR  Grant  No.  77-3152. 
The  abstract  structure  of  the  discrete  control  problem  as  it  relates  to  manned 
systems  has  been  refined  and  clarified.  It  has  been  shown  that  input-output  data 
(information  inputs  to  the  operator,  decision  outputs  from  him)  are  representable 
by  stochastic  automata,  a special  type  of  discrete  parameter,  discrete  state  sto- 
chastic process.  Further,  the  detailed  structure  of  these  systems  has  been  ex- 
amined and  it  has  been  shown  that  automata  based  on  1^  order  state  spaces  (i.  e. , 
states  are  sequences  of  outputs  including  the  present  and  preceding  1-1  outputs) 
serve  as  excellent  surogates  for  more  general  systems.  TTiese  1^^  order  systems 
have  the  distinct  advantage  of  being  observable  from  input-output  data,  and  trans- 
ition probability  estimates  can  be  easily  constructed.  Identification  and  parameter 
estimation  algorithms  based  on  1^^  order  systems  have  been  developed. 

The  AAA  system  simulated  by  AMRL  has  been  studied  in  detail  and  the 
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structure  of  a stochastic  automaton  representation  has  been  constructed.  This 


model  was  used  to  define  explicit  data  requirements  for  discrete  control  modeling 
of  this  system  and  to  design  the  discrete  control  experiments  to  be  performed  on 
it.  Data  obtained  from  these  experiments  have  been  analyzed  and  the  results  are 
presented. 

The  results  are  a set  of  state  transition  matrices  and  probability  distribu- 
tions which  stochastically  characterize,  as  a function  of  the  input  when  the  oper- 
ator will  switch  the  mode  of  operation  or  configuration  of  the  system  and  what  the 
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new  configuration  will  be.  The  results  show  that  finite  state  models  of  the  human 
operator  performing  discrete  control  tasks  can  be  developed  and  identified  from 
data.  They  further  verify  the  feasibility  of  using  a hierarchical  structure  to  avoid 
combinatorial  problems  and  maintain  identifiability. 


I.  Introduction 
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This  research  is  based  on  the  hypothesis  that  many  manual  control  systems 
are  hierarchical  in  structure  and  that  many  upper  level  tasks  are  best  described 
in  discrete  control  terms.  Loosely,  a task  is  a discrete  control  task  if  an  oper- 
ator is  attempting  to  coordinate  or  control  the  activities  of  some  system  with  a 
finite  number  of  control  alternatives.  Methods  for  modeling  such  systems  are 
lacking.  In  particular,  there  is  a need  for  mathematical  structures  which  are 
rich  enough  in  properties  to  provide  insight  into  discrete  system  behavior  and 
yet  are  simple  enough  to  be  useful  for  parameter  estimation  and  analysis  without 
an  excessive  amount  of  computation.  Hie  research  completed  to  date  with  the 
support  of  AFOSR  Grant  #77-3152  has  shown  that  stochastic  automata  are  very 
viable  structures  for  these  purposes. 

The  major  tasks  which  were  to  have  been  accomplished  at  this  point  of  the 
research  are  the  following: 

1.  Develop  discrete  control  model  structure. 

2.  Develop  parameter  estimation  algorithms. 

3.  Write  computer  code  for  data  analysis  and  parameter  estimation. 

4.  Simulation  experiments  at  AMRL. 

5.  Analysis  of  data. 

Each  of  these  tasks  has  been  completed.  The  abstract  structure  of  the  discrete 
control  problem  has  been  defined  and  clarified.  A detailed  multilevel  system  de- 
scription of  the  system  simulated  by  AMRL  has  also  been  constructed.  The 
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parameter  estimation  and  data  analysis  methods  have  been  developed  and  computer 
programs  have  been  written  and  used  to  analyze  the  simulation  data. 

Detailed  discussions  of  the  research  are  given  in  the  following  sections  of 
the  report.  Abstract  set  theoretic  descriptions  of  discrete  control  systems  and 
the  general  identification  problem  are  provided  in  sections  II  and  lEL  Constructive 
specification  and  more  detailed  models  are  discussed  in  sections  IV  and  V.  In 
section  VI,  the  identification  procedures  specialized  to  the  AMRL  system  are  con- 
sidered and  a brief  summary  of  the  analysis  procedures  is  given  in  section  VIL  A 
summary  of  the  results  of  data  analysis  is  presented  in  section  Vin. 


IL  Abstract  Structure  of  Discrete  Control  Systems 

The  block  diagram  shown  in  Figure  1 is  an  abstraction  of  the  type  of  system 
of  interest.  The  major  components  are  the  controlled  system  S,  an  interface  sys- 
tem I,  and  the  controller  or  decision  maker  DM.  The  system  S is  shown  as  con- 
sisting of  several  subsystems.  These  subsystems  might  be  actual  physically  inter- 
connected systems  which  operate  simultaneously,  or  they  might  represent  the 
dynamics  of  S under  different  modes  of  operation.  ITie  decision  maker  coordinates 
the  operation  of  S (for  example,  switches  the  mode  of  operation)  through  use  of  the 
control  m.  m is  assumed  to  have  a finite  number  of  possible  values,  one  per 


♦ Tables  and  figures  are  in  appendices  at  the  end  of  the  report. 


4 


fl 


2 


alternative  available  to  the  decision  maker.  Any  continuous  control  tasks  also 
performed  by  the  operator  are  assumed  to  be  performed  directly  at  the  level  S and 


not  at  the  DM  level. 

The  information  interface  system  is  also  shown  as  consisting  of  multiple 
information  sources  and/or  multiple  information  processing  schemes.  The  decision 
maker  exercises  control  over  the  operation  of  I via  the  control  n.  The  interface 
system  is  considered  to  be  some  physical  system  such  as  a bank  of  instruments 
or  a computer.  Any  information  processing  done  by  the  operator  himself  is  not 
represented  by  I,  but  included  in  DM. 

The  modeling  objectives  all  deal  with  the  DM  component  of  this  system, 
i.  e. , the  human  operator  or  decision  maker.  At  this  point  only  an  input-output 
description  is  required.  In  terms  of  inpat-output  behaviors,  the  system  DM  is 
abstractly  equivalent  to  a relation 
DM  ^ Q X (M  X N) 

where  the  defining  objects  Q,  M,  N are  sets  of  time  functions,  the  input  and  output 
behaviors.  Formally,  if  T denotes  the  time  set  of  task  then 

Q C M C d"^;  N C \ 

Ihe  superscript  notation  is  used  to  identify  sets  of  the  following  fype 
= { q|q:  T ^ C } 

That  is,  C is  the  set  of  all  functions  on  domain  T into  the  set  C.  ITie  remaining 
objects  are  defined  similarly.  The  elements  of  the  set  C are  distinct  inputs  to  the 
operator.  C may  be  multi-dimensional  in  the  sense  that  it  is  a cartesian  product 
on  more  elementary  sets.  The  sets  D and  E are  the  control  alternative  sets 
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available  to  the  operator.  Elements  in  D are  information  system  alternatives; 

E contains  the  alternatives  by  which  the  system  S is  controlled.  In  the  problems 
of  interest  the  decision  maker  has  available  only  a finite  number  of  alternates 
which  means  that  the  sets  D and  E are  of  finite  cardinality. 

The  relation  DM  is  viewed  as  the  basic  structure  to  be  examined  experi- 
mentally and  described  mathematically.  The  main  steps  in  representing  this 
structure  are  outlined  below. 

The  basic  system  is  the  input-output  relation 
DM  C Q X (M  X N) 

Every  relation  of  this  type  can  be  decomposed  into  two  systems,  an  input-state 
system  and  a state-output  system.  Specifically,  there  exist  (non-unique)  sets  F 
and  Z and  systems  Sj  and  S2  such  that 
Z c f 

and 

Sj  Q X Z 

C Z X (M  X N) 

I and 

DM  = S,  o Si . 
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The  set  Z is  the  set  of  state  trajectories  for  DM  and  F is  the  state  space.  Essen- 
tially this  construction  says  that  underlying  any  input-output  relation  is  a pair  of 
relations,  the  input-state  relation  Sj  and  the  state-output  relation  Sg,  whose  com- 
position is  the  relation  DM  itself.  It  is  convenient  to  assume,  with  no  loss 
of  generality,  that  S2  is  a static  system.  That  is,  knowledge  of  the  state  at  time  t 


, j*--  r.' 


is  sufficient  to  determine  the  output  at  time  t.  More  precisely  S2  static  means 
there  is  a map  h, 

h : F -♦  D X E, 

such  that  for  every  element  (Z,  (m,  n)  ) e Sg  and  for  every  t e T, 

(m  (t).  n(t)  ) = h (Z(t)  ). 

Ilie  information  about  the  system  response  is  therefore  encoded  primarily  in  the 
input-state  system  Sj. 

A general  stochastic  characterization  of  the  DM  system  is  most  easily 
based  on  the  system  Sj.  Recall  that 
Sj  C Q X Z 

A probability  space  can  be  defined  with  as  the  sample  space,  and  the  probability 
measure  on  DM  follows  through  the  static  system  S2.  The  result  is  that  DM  can 
be  considered  to  be  the  sample  space  of  a probability  space  which  is  constructed 
via  the  state  decomposition  of  DM.  Stochastic  processes  appropriate  for  analysis 
and  detailed  modeling  are  now  outlined. 

in.  A Stochastic  Process  Representation  of  the  System 

To  each  input,  output  and  state  is  assigned  a numerical  name.  Formally, 


gf  : 

C ->  Nj 

Nj  = {1,2,3,-..  kj} 

80  = 

D X E-^Nq  ; 

Nq  = (1,2,3,...  k^} 

«s  • 

F-Ng  ; 

Np  = (1,2,3,...  kg} 

A finite  number  of  inputs  are  Identified  with  gp  numerical  names  are  assigned  to 
outputs  via  g and  states  are  similarly  identified  with  the  map  g . 

U 0 
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A random  variable  defined  on  the  sample  space  Sj  is  a map  of  the  form 


X ; S,  > N,  X N 
1 [ s 


Now  let  X denote  the  set  of  all  such  random  variables  and  let  T'  denote  the  sample 
point  time  set, 

X = { X I X ; Sj  -»  Nj  X Ng  } 
t'  = {O,  8,  26  •••  },  t'c  T 

A stochastic  process^  defined  on  Sj  is  a family  of  random  variables  indexed  by  time, 
J : t'  X 

For  convenience  a random  variable  in  the  range  of  *f,  J (t)  €X,  is  denoted  by  the 
symbol  x^.  The  defining  characteristic  of  the  process  is 

Xj.(q,  z)  = {gj  (q(t)  ),  gg  (Z(t)  ) },  (q,  z)  e Sj 
That  is,  the  random  variable  x^.  produces  as  values  the  numerical  name  of  the  input 
and  state  at  time  t.  A sample  path  of  the  process  corresponding  to  an  outcome 
(q,  z)  e Sj  is  then  a time  function  of  the  form 

s(q,  z)  = {(t,  (n,m)  ) | (n,m)  = Xj  (q,  z)  } 

Clearly,  points  on  the  sample  path  are  the  random  variable  values  at  that  point. 

TTie  ensemble  £ corresponding  to  Sj  is  then  the  set  of  all  sample  paths, 

£ = { s(q,z)  I (q,  z)€Sj}. 

These  structures  are  the  basic  objects  of  the  required  detailed  mathematical 
models.  Before  developing  detailed  representations,  the  "event"  characteristics 
of  the  sample  paths  are  clarified. 

The  sets  Np  N^,  Ng  are  assumed  to  be  Bnite  for  this  problem.  Tliat  is, 
there  are  only  a finite  number  of  inputs,  states  and  outputs  of  interest.  This  suggests 
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that  in  the  limiting  case  where  the  time  between  samples,  8 , approaches  zero 
the  sample  paths  would  be  piecewise  constant.  That  is,  the  input  symbol  applied 
remains  the  same  for  some  period  of  time  before  it  changes.  Similarly,  the  state 
is  constant  for  some  period  of  time.  An  event  can  then  be  defined  as  either  a 
change  in  input  or  a change  in  state.  Furthermore  any  sample  path  is  completely 
characterized  by  a sequence  of  pairs  of  the  form 
(il*  tj).  (^2'  *2^  * * * ^^n’  ^n)  * * * 

where  the  first  symbol  in  each  pair,  say  i^^,  is  the  symbol  applied  and  the  second 
element  of  the  pair,  t^^,  is  the  length  of  time  that  symbol  is  applied.  Sample  path 
behaviors  are  therefore  characterized  by  the  symbol  applied  and  the  length  of  time 
the  symbol  is  applied. 

IV  Constructive  Specification 

The  probabilistic  apparatus  considered  to  this  point  characterizes  the 
overall  sample  space,  i.  e. , the  behavior  of  the  system  DM,  but  does  not  address 
the  properties  of  any  given  sample  path.  Data  analysis  and  system  representation 
are  greatly  simplified  by  a representation  in  terms  of  a state  transition  function. 
Such  a function  would  establish  the  probability  of  occupying  any  state  at  the  next 
time  point  t + 6 as  a function  of  the  state  occupied  at  time  t and  the  input  in  the 
interval  between.  In  general,  the  transition  also  depends  on  the  length  of  time  the 
given  state  has  been  occupied. 

A state  occupancy  probability  distribution  is  a map  of  the  form 

: Ng-  [0,  n 

which  associates  the  probability  of  occupancy  with  each  state  in  this  state  space. 
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If  denotes  the  set  of  all  such  probability  distributions,  the  state  transition 


map  is  n map  of  the  form 

<|>  : T X Ng  X Nj—  *0^ 

If  0 (t  + 6)  is  the  state  occupant^  distribution  at  time  t + S,  the  input  is  symbol  i 
and  state  j is  currently  occupied  and  has  been  for  t units, 

0 (t  + &)  = <t>  (T,  j,  i). 

In  other  words,  the  next  distribution  is  conditioned  on  the  input,  the  state  and  the 
time  since  the  last  state  change  event,  A major  part  of  the  modeling  exercise  is 
to  identify  the  map4>. 

Before  turning  to  detailed  representation  of  the  system,  outputs  must  be 
reintroduced.  It  was  assumed  that  states  were  defined  in  such  a way  that  outputs 
were  deterministically  related  to  states,  i.  e. , 
n : F-*  D X E . 

Now,  in  terms  of  state  names,  consider  a map  hg, 

^ • M — ^ M 

s “ s o 
defined  so  that 

hg  * Ss  ~ Sq  ’ 

In  terms  of  a commutative  diagram 


D X E 


The  map  hg  is  defined  so  that  the  same  output  name  is  reached  given  the  state 
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name  as  Is  reached  from  first  assigning  the  output  and  thus  Identifying  the 


1 
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output  name.  The  map  hg  induces  a partitioning  of  the  set  Ng.  For  each  element 
k e N there  exist  a subset  of  N_,  say  h_  1 k such  that  for  each  element  j € h_  | k, 

V So  B 

(j)  ~ The  probabilily  of  output  k is  therefore 
s 

E 4.(1) 
l€hjk 

where  <}>  is  the  appropriate  state  occupancy  distribution. 

The  state  transition  map  ({>  and  output  assignment  map  hg  can  be  used  to 
establish  the  conditional  probability  of  an  output  sample  path  given  the  input  sample 
path  and  initial  state  occupancy  distribution.  Furthermore,  matrix  representations 
are  possible. 

The  map  ()>  assigns  kg  probabilities  to  each  of  kg  states  given  the  length  of 
state  occupancy  t and  the  input  i.  Hierefore,  (|>  is  represented  by  a family  of 
kg  X kg  matrices  each  of  which  is  parameterized  by  the  input  and  time.  Specif- 
ically let  P (i,  T ) denote  the  kg  x kg  matrix  whose  entry  in  row  m column  n is  the 
probability  that  state  n will  be  occupied  at  time  t + 5 given  the  state  at  t is  m and 
m has  been  occupied  for  x units,  i.  e. , the  m***  row  of  P (i,  x ) is  the  state  occu- 
pancy distribution  at  t + B given  the  above  mentioned  information. 

These  structures  can  be  simplified  considerably  if  the  state  to  which  the 
next  transition  is  made  is  independent  of  the  time  at  which  the  transition  occurs, 
assuming  constant  input.  If  s denotes  the  time  between  two  state  change  events,  t^ 
is  time  of  last  event,  the  state  at  t^  is  i,  the  state  at  tj^  +6  is  j,  and  the  input 
throughout  is  k,  this  iixlependence  assumption  requires 
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' Prob  (Z  (tj  + s)  = j Z (tj)  = i and  q(tj)  = k)  = 

P(k,  8)^^  . - P(k)j^^  ♦ f(s) 

P(k,  8)  . i8  the  i,  element  of  the  traneition  matrix  P(k,  8),  P(k)  i8  the  marginal 
M J 

transition  matrix  computed  from  P(k,  t)  by  integrating  out  t;  similarly  P(8)  is 

A 

the  marginal  obtained  by  integrating  out  the  input  dependence.  P (k)  then  defines 

conditional  state  transition  probabilities  at  the  next  event,  f is  the  distribution 

of  event  occurence  times  in  the  presence  of  constant  input  k.  Hie  independence 

assumption  greatly  reduces  the  complexity  of  these  stochastic  automata  models 

and  similarly  reduces  data  required  for  estimation  and  yet  leaves  a robust  structure 

in  the  sense  that  it  has  the  power  to  represent  diverse  sets  of  data. 

The  stochastic  automata  described  above,  i.  e. , a family  of  transition 

matrices  P(k,  t)  and  the  output  assignment  map  h_  are  the  basic  components  of  any 

s 

input-output  representation  of  the  human  operator  in  a discrete  control  system. 

The  identification  problem  is  one  of  determining  the  state  space  and  estimating 
the  state  transition  probabilities  from  the  existing  data.  Hie  state  space  of  the 
operator  is  never  known  beforehand  and  state  sequences  are  therefore  certainly  not 
observed.  * Recall  that  DM  was  a set  of  input  time  function-output  time  function 
pairs.  Hie  sample  paths  observed  then  do  not  contain  the  state  trajectories  and 
standard  maximum  likilihood  estimates  cannot  be  used  to  estimate  the  transition 
probabilities  of  a general  stochastic  automaton  . An  observable  approximation 
based  on  1^  order  Markov  processes  is  discussed  in  the  next  section. 
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* These  states  can  be  thought  of  as  the  operatoi^s  state  of  information  and 
the  outside  observer  does  not  know  the  operator's  knowledge  of  the  system  he  is 
controlling.  Furthermore,  he  does  not  know  how  the  operator  represents  that 
Information. 


An  Observable  Approximation 


Let  Aj  denote  a general  stochastic  automaton  of  the  type  defined  in  the 
previous  section.  Let  A2  denote  a second  stochastic  automaton  constructed  from 
a family  of  1^^  order  Markov  chains.  Assuming  that  there  are  distinct  decision 
alternatives,  L e. , kg  elements  in  the  set  D x E,  an  1^^  order  Markov  system  de- 
fined  on  this  output  space  has  exactly  1 ® states.  Each  state  is  a sequence  con- 
sisting of  tiie  current  and  the  previous  1-1  outputs.  The  output  assignment  map 
for  this  system  is  obvious.  Note  that  the  state  sequence  for  system  is  obser- 
vable from  the  input-output  data.  The  1^  order  Markov  system  will  be  used  to 
approximate  the  more  general,  but  imobservable,  system  Aj. 

Suppose  that  both  Aj  and  are  given  and  recall  that  the  relation  DM  con- 
sists of  pairs  of  input-output  functions  of  the  form  (q,  o).*  Now,  let  p^iolq)  denote 
the  probability  that  output  sequence  o is  produced  by  system  A^  given  the  input 
sequence  q.  Let  P2  (o|q)  denote  the  same  for  system  A2.  The  system  Ag  is  said 
to  be  input-output  equivalent  to  Aj  if  Pj  and  Pg  are  sufficiently  close  for  all  pairs 
(q,  o)  of  interest. 

It  is  shown  in  Appendix  1 that  if  time  varying  transition  probabilities 
are  allowed  in  the  system  A2,  then  P2(<’I<1)  can  be  made  to  exactly  equal  p^.  When 
the  transition  probabilities  are  constrained  to  be  constants,  the  error  in  approxi- 
mation is  a function  of  the  order  of  the  chain  1 and  the  transition  probabilities  of 
the  system  Aj.  Specifically,  the  proportional  error  in  the  input-output  transition 
probabilities  is  bounded  from  above  by 

*0  is  used  to  represent  the  pair  (m,  n) 
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' max  ’ 

where  t is  the  time  of  the  transition  imd  ' is  the  maximum  eigenvalue  of 
l’l(‘l(t))  which  is  the  transition  matrix  of  using  the  appropriate  input  q(t).  TTie 
maximum  eigenvalue  is  the  largest  eigenvalue  less  than  one.  Hence  the  bound  de- 
creases with  time. 


The  largest  error  incurred  is  at  t = 1,  hence  the  order  of  the  chain  directly 
controls  the  error.  By  selecting  1 sufficiently  large,  the  error  will  be  small.  A 
formal  proof  of  the  bound  is  found  in  Appendix  1.  Intuitively,  the  bound  is  closely 
tied  to  the  transient  behavior  of  the  system.  With  the  1^^  order  structure,  estimates 
of  state  transition  probabilities  cannot  be  made  until  at  least  1 transitions  have 
occurred.  If  the  transient  effects  have  decayed  by  this  time,  the  approximation 
is  quite  good. 

The  1*^  order  Markov  approximation  therefore  works  well  when  1 is  suf- 
ficiently large.  Obviously,  the  maximum  eigenvalue  cannot  be  known  beforehand, 
but  by  successively  testing  the  hypothesis  that  the  system  is  order  1 against  the 
alternate  that  it  is  order  1+1,  one  can  get  a statistical  determination  of  the  chain 
order.  Experience  with  simulated  systems  (in  Appendix  2)  has  shown  that  such 
procedures  work  very  well  and  the  required  order  is  substantially  lower  than  the 
upper  bound  indicates.  Essentially  then,  1^  order  Markov  processes  conditioned 
by  the  input  provide  the  statistical  apparatus  necessary  to  identify  the  state  space 
of  the  finite  state  system  and  to  estimate  transition  probabilities.  The  details  of 
the  parameter  estimation  procedures  for  such  systems  are  presented  in  Appendix  3. 

In  summary,  it  has  been  argued  that  the  data  obtained  from  a discrete  control 
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system  is  of  the  same  abstract  structure  as  a general  stochastic  automata.  It 


has  been  further  argued  that  stochastic  automata  based  on  order  Markov  sys- 
tems are  excellent  surogates  for  the  more  general  systems  and  they  are  obser- 
vable from  data.  The  application  of  these  concepts  to  the  AMRL  simulator  la 
discussed  in  the  next  section. 

VL  Empirical  Testing 

Strucfajre  of  the  System 

The  basic  macroscopic  stucture  of  the  simulated  system  is  sketched  in 
Figure  2.  Hiese  diagrams  identify  all  major  system  components  and  explicitly 
show  the  points  at  which  discrete  decisions  made  by  the  system  operators  influence 
the  system  configuration. 

Rectangular  blocks  are  used  to  define  hardware  and  human  components, 
circles  with  summation  signs  denote  signal  summing  junctions,  and  circles  with 
numbers  denote  off  page  signal  connections.  The  symbol  is  used  to  denote 
logical  variables  or  switches  controlled  by  the  operators.  These  blocks  denote 
the  outputs  of  the  discrete  decision  systems  which  are  the  primary  subject  of  the 
analysis. 

Figure  2 together  with  the  state  definitions  which  are  provided  below,  can 
be  used  to  establish  the  system  configuration  during  any  operating  mode  and  any 
operator  activity.  Table  1 is  a list  of  all  such  indicator  variables  and  the  enabling 
conditions  for  each. 

Model  Structure 

The  modeling  and  analysis  effort  will  be  based  on  a decomposition  of  the 
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system  in  terms  of  a basic  sequence  of  activities  or  functions.  For  each  activity, 
the  system  configuration  decisions  will  be  further  broken  down  and  described  in 
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terms  of  a commander  subsystem,  an  angle  operator  subsystem,  and  hardware 
subsystems.  All  identified  system  components  and  functions  are  listed  in  Table  2. 
Also  included  in  the  same  table  is  a list  of  major  states  for  each  component  sub- 
system and  the  operator  responsible  for  controlling  the  subsystem  state. 

Time  Sequence  or  Activity  States 

The  major  functions  performed  by  the  system  are  search,  acquire,  track 
and  fire.  In  any  given  operational  situation  the  system  will  pass  through  all  or  a 
subset  of  these  phases  and  transitions  are  indicated  by  a fairly  well  defined  set  of 
exogenous  events.  The  state  transition  diagram  together  with  enabling  inputs  are 
shown  in  F gure  3.  The  search  state  is  used  when  an  acceptable  target  has  not 
been  detected  or  acquired.  Acquisition  follows  and  is  noted  by  a switch  to  a manual 
tracking  mode.  Tracking  starts  when  the  angle  operator  has  minimized  errors. 
Tracking  continues  in  either  an  automatic  or  manual  mode.  The  fire  mode  is 
entered  when  the  data  ready  event  occurs  or  the  computer  is  shunted. 

Commander — Angle  Operator  States 

Separate  angle  operator,  commander  and  hardware  configuration  systems 
are  defined  for  each  activity  state.  This  results  in  a total  of  eight  distinct  systems 
plus  hardware  systems.  The  state  spaces  for  all  such  systems  are  defined  via 
state  trees  presented  in  Figures  4-11. 

For  purposes  of  analysis,  the  activity  state  will  serve  as  the  major  indicator 
and  the  angle  operator  states  and  commander  states  will  establish  current  macro- 
scopic activity  and  configuration  variables.  Hardware  states  will  be  considered 
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outputs  (probabilistic)  unless  empirical  evidence  is  found  to  show  that  they  must 
be  included  in  the  system  state  space. 


There  is  a very  clear  hierarchy  used  in  the  state  definition  procedure. 

The  activity  state  is  the  highest  level  followed  by  the  commander  state,  followed 
by  the  angle  operator  state  which  is  followed  by  the  hardware  configuration.  TTiis 
breakdown  greatly  reduces  the  dimensionality  of  the  problem  and  reduces  the 

! 

number  of  parameters  which  must  be  identified  from  data. 

Firing  Policy 

When  the  system  is  in  the  firing  mode,  the  actual  firing  activities  are 
accomplished  according  to  an  established  policy  or  doctrine.  The  required  activity 
states  are  illustrated  in  Figure  12.  TTie  diagram  is  drawn  in  terms  of  states  listed 
in  Table  3. 

Description  of  Inputs 

Actions  taken  by  the  human  operators  in  the  system  presumably  are  based 
on  information  available  to  them  about  target  actions  and  system  performance. 

The  required  information  sets  have  not  been  completely  defined  and  cannot  be  imtil 
some  preliminary  simulation  data  is  available.  A preliminary  definition  for  the 
angle  operator  is  given  below. 

The  basic  input  inforrnation  is  assumed  to  consist  of  the  following  variables 
listed  in  Table  1.  Except  for  channel  status  which  is  a binary  indicator  of  the 
operating  status  of  the  radar  and  optical  displays,  these  variables  are  continuous. 
They  are  discretized  with  the  following  rules  defined  in  Table  5.  The  procedure 
is  straightforward  with  the  possible  exception  of  the  angle  error  procedure  X^. 
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Basically,  a four  dimensional  ellipsoid  is  used  to  separate  the  angle  related 
inputs  into  in  bounds  and  out  of  bounds  categories. 


The  assignment  of  input  symbols  is  accomplished  with  the  tree  structure 
shown  in  Figure  13. 

Models  Used  in  Analysis 

The  basic  structure  employed  in  the  analysis  is  that  of  a stochastic  autom- 
ata with  1^^  order  states.  There  is  one  such  system  for  each  of  the  eight  activity — 
commander — angle  operator  subsystems  mentioned  earlier,  although  in  the  cur- 
rent experiments  only  the  range  and  angle  operator  system  are  considered.  Each 
automata  is  represented  by  a set  of  matrices,  one  matrix  per  discrete  input  and  time 
in  state  distribution.  These  matrices  define  the  state  transition  probabilities  for 
the  corresponding  system. 

Design  of  Experiments 

Data  were  collected  from  the  AMRL  simulation  to  meet  the  needs  of  this 
research.  The  technical  sections  of  the  protocol  used  for  these  experiments  are 
reproduced  in  Appendix  4. 

VII.  Data  Analysis  Procedures 

Data  from  the  AMRL  experiments  are  in  the  form  of  time  series  describing 
input-output  sequences.  It  basically  corresponds  to  the  relation  DM  described  in 
section  IL  From  this  data  was  determined  the  state  transition  matrices  of  describ- 
ing stochastic  automata.  The  procedures  are  outlined  below  and  in  the  accompanying 
functional  flow  charts.  The  results  are  discussed  in  the  next  section. 

The  preliminary  statistical  analysis  of  the  data  was  divided  into  three 
phases  for  the  purposes  of  writing  computer  programs:  a preprocessor  transition 
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count  routines  and  calculation  of  the  parameters  and  statistical  testing  (see 
Figures  4,  5,  and  6).  A brief  description  of  each  of  these  phases  follows. 


The  preprocessor  uses  the  raw  data  to  perform  three  functions:  1)  deter- 
mine major  state  (mode  of  operation),  2)  determine  the  appropriate  symbols  for 
input  and  output  signals,  and  3)  record  the  time  the  system  is  using  each  input/ 
output  combination.  The  major  states  used  are  search,  acquire  and  track.  Levels 
of  tracking  and  range  errors  were  used  to  determine  which  of  these  states  the  sys- 
tem is  in,  and  parameters  were  collected  on  each  major  state  individually. 

The  magnitude  of  the  range  and  angle  errors,  as  well  as  the  operational 
status  of  the  optical  and  radar  displays,  was  used  to  define  eight  input  symbols, 
each  of  which  is  defined  by  a given  combination  of  these  indicators.  The  output 
symbols  were  defined  in  the  same  manner  as  angle  operator  states  in  the  state 
trees,  each  output  symbol  depending  on  the  present  major  state  (mode)  of  the  sys- 
tem. Lastly,  the  length  of  time  the  present  major  state,  input  and  output  combina- 
tion is  occupied,  was  recorded.  This  information,  as  well  as  the  leader  record 
for  each  run,  was  stored  for  later  use  by  the  transition  counting  routines. 

The  fimction  of  the  transition  counting  routine  is  to  keep  track  of  the  total 
amount  of  time  an  input-output  combination  is  occupied,  the  sum-of-squares  of 
these  times,  and  the  number  of  transitions  from  these  input-output  combinations 
to  any  given  output  symbol.  In  addition,  provisions  were  made  to  allow  up  to  five 
old  input- output  combinations  to  be  defined  as  the  current  state  for  purposes  of 
counting  the  transitions  to  the  next  output,  thus  allowing  us  to  study  a fifth- order 
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chain  of  states.  This  information  was  combined  for  all  runs  of  each  team  and 
trajectory  combination.  It  was  then  used  to  calculate  the  system  parameters. 

The  parameter  estimation  routines  calculate  the  maximum  likelihood  esti- 
mate of  the  transitions  defined  under  the  counting  portion.  In  addition,  the  vari- 
ances of  these  values  and  the  mean  time  in  state  were  calculated,  and  a Chi-square 
test  was  performed  to  determine  which  chain-length  has  the  most  significance  to 
the  system  under  study.  The  option  is  available,  at  this  time,  to  combine  the 
transition  counts  of  various  teams  or  trajectories  and  calculate  the  parameters  of 
these  aggregate  systems.  The  output  of  this  portion  consists  of  the  estimates  of 
the  system  parameters  and  an  indication  of  the  chain  length  having  the  most  signif- 
icance for  this  system,  as  well  as  the  identifiers  of  the  team(s)  and  trajectory (s) 
used  in  this  estimation. 


VIII.  Summary  of  the  Results 

Deviations  from  the  Protocol 

Certain  adjustments,  dictated  by  hardware  and  resource  constraints,  were 
made  in  the  protocol  during  the  eollection  of  data.  The  major  changes  Included  the 
following: 

1)  Use  of  only  7 trajectories,  trajectories  1,  2,  4,  7,  8,  9,  10  as 
detailed  in  the  protocol. 

2)  Use  of  four  teams  instead  of  six. 

3)  A total  of  560  runs  Instead  of  1200. 

4)  No  perturbation  of  the  range  signal  without  simultaneous 


The  first  modification  simply  eliminated  three  trajectories  which  had  char- 
acteristics very  similar  to  other  trajectories  which  were  used  and  caused  no  major 
impact  on  the  experiment  or  the  analysis.  The  reduction  in  the  number  of  teams 
was  dictated  by  the  available  resources  and  since  comparing  performance  across 
teams  was  not  a major  objective,  this  change  also  did  not  in  itself  influence  the 
experiment.  Because  of  time  and  resource  constraints,  the  number  of  replications 
by  team/trajectory  combination  was  not  increased  when  the  above  mentioned  adjust- 
ments were  made.  This  cut  the  total  number  of  runs  available  by  more  than  50  per- 
cent. This  did  some  damage  to  the  statistical  reliabilify  of  certain  parameter 
estimates,  but  the  objectives  were  to  demonstrate  the  parameter  estimation  pro- 
cedures rather  than  provide  substantive  data.  The  fourth  adjustment  would  have 
been  critical  if  substantive  interpretations  needed  to  be  provided  for  the  parameter 
estimates,  but  again,  the  pilot  nature  of  this  set  of  experiments  makes  this  change 
noncrltical. 

Summary  of  the  Definitions  of  Inputs  and  States 

The  analysis  procedures  followed  the  outline  presented  in  sections  VI  and 
Vn  of  this  report.  Inputs  were  defined  according  to  the  logic  displayed  in  Figure  13. 
Decision  criteria  for  the  inputs  are  summarized  in  Table  6 of  Appendix  7. 

Major  states  were  assigned  according  to  Figure  3 and  angle  operator  states 
were  assigned  according  to  Figures  4 and  5 with  two  exceptions.  First,  the  search 
states  were  simplified  to  search- radar  and  search-optical  by  deleting  the  scan  modes. 
Similarly,  the  acquire  modes  were  simplified  to  acquire- radar  and  acqulre-optical. 
There  was  also  no  captain  state  in  this  simulation.  These  adjustments  were  made 
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to  simplify  the  data  analysis  and  cut  down  data  storage  requirements.  They  have 
little  substantive  impact  since  behaviors  were  close  to  deterministic  for  all  search 
and  acquire  activities.  The  operational  definitions  of  all  states  used  in  the  analysis 
are  given  in  Tables  7 and  8 of  Appendix  7. 

Summary  of  Events  Data 

A summary  of  all  events  reflected  in  the  data  is  given  in  Tables  9 and  10 
of  Appendix  7.  Inputs  two  and  three,  particularly  two,  occurred  substantially 
fewer  times  than  the  others.  Input  two  was  both  optics  and  radar  blanked  and  input 
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three  was  radar  blanked  with  az/el  errors  out  of  bounds.  Input  two  seldom  occurred 


k 


because  of  the  simulator  configuration  and  subject  training.  If  the  angle  operator 
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was  viewing  the  optical  display  at  the  time  of  blanking,  both  the  optical  and  radar 
displays  were  blanked  leaving  no  active  display.  The  subjects  quickly  learned  this 
fact  and  used  primarily  radar  when  in  the  auto  track  mode  and  susceptible  to  blank- 
ing. In  this  case,  when  the  blanking  was  initiated  only  the  radar  system  was  im- 
pacted leaving  the  optical  system  available  for  use. 

The  fact  that  input  three  occurred  only  a small  number  of  times  reflects 
the  fact  that  range  errors  tended  to  be  large  during  blanking  since  no  range  display 
was  available  during  this  period.  Hence,  inputs  four  or  five  were  the  dominant  ones. 
Also,  one  would  expect  input  three  to  apply  for  a few  seconds  after  the  on  set  of 
blanking.  That  is,  during  auto  track  one  would  expect  that  tracking  errors  would 
be  small  and  would  remain  small  for  a short  period  after  blanking.  This  suggests 
that  input  three  should  occur  on  nearly  all  blanked  runs,  and  it  apparently  did.  The 
total  number  of  blanked  runs  wsis  392  out  of  the  total  560.  There  were  388  occur- 
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rences  of  input  three. 
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Inputs  seven  and  eight  occurred  an  extraordinarily  large  number  of  times. 
These  inputs  correspond  to  the  situation  in  which  the  radar  system  is  operating, 
angle  errors  are  in  bounds  and  range  error  is  in  bounds  or  out  of  bounds,  re- 
spectively. Because  of  calibration  problems  or  sequencing  of  the  data  there  was 
a tendency  for  range  error  to  go  in  and  out  of  bounds  generating  a large  number  of 
input  change  events.  Tlie  exact  cause  is  not  clear,  but  it  most  likely  is  a difference 
in  the  limits  used  in  range  error  calculations  during  analysis  and  the  actual  range 
error  bounds  for  auto  track.  The  data  were  analyzed  after  combining  inputs  seven 
and  eight  to  get  a better  measure  of  decision  activity. 

The  only  state  not  used  was  major  state  three,  state  six,  which  corresponded 
to  tracking  in  mode  two  with  optical  information.  This  state  was  not  occupied  for 
basically  the  same  reasons  given  above  for  input  two.  Mode  one  was  the  preferred 
tracking  mode  for  this  simulation  and  subjects  used  mode  two  only  when  they  forgot 
to  switch  back  to  mode  one.  (Mode  switches  were  randomly  set  at  the  start  of  each 
run. ) Furthermore,  manual  tracking  prior  to  entering  auto  track  for  this  first 
time  was  accomplished  with  radar  because  of  the  blanking  characteristics  discus- 
sed under  input  two  above.  If  a subject  forgot  to  reset  the  mode  switch  to  mode  one 
and  attempted  to  enter  auto  track  while  assuming  the  system  was  in  mode  one,  auto 
track  would  not  be  maintained  because  the  angle  errors  would  rapidly  increase. 

Major  state  one,  state  one,  was  occupied  only  four  times  showing  a clear 
preference  for  the  radar  display  during  search.  Acquisition  was  accomplished  using 
both  radar  and  optics,  with  radar  the  preferred  mode.  The  other  states  with  a low 
number  of  occurrences  were  major  state  three,  states  five,  seven,  and  eight.  These 


21 


all  are  mode  two  related  states  and  were  seldom  occupied  for  the  reasons  given 
above  for  state  six. 


State  transition  probability  estimates  depend  not  on  the  number  of  times  a 
state  was  occupied,  but  on  the  number  of  times  a state  change  originated  from 
that  state,  i.  e. , on  the  number  of  transitions.  The  number  of  transitions  is  sub- 
stantially less  than  the  number  of  occupancies  because  of  the  hierarchical  struc- 
ture of  the  model  and  the  input  dependence.  That  is,  a major  state  change  is  not 
a transition  and  does  not  provide  a transition  count  in  a lower  level  activity  state. 
Furthermore,  an  input  change  can  result  in  an  occupancy  for  two  distinct  config- 
urations (major  state-input-activity  state)  with  one  or  perhaps  no  state  transitions 
at  the  activity  state  level, 

A summary  of  state  occupations  and  transitions  by  major  state-input-activity 
state  is  provided  in  Table  10.  It  is  clear  from  this  table  that  almost  no  decision 
activity  took  place  when  the  system  was  in  major  state  one,  i.  e. , during  search. 
Decision  activity  during  the  acquisition  of  a target  was  concentrated  at  inputs  three 
and  five.  These  are  cases  in  which  the  radar  was  blanked  and  the  tracking  errors 
were  out  of  bounds.  The  transitions  were  predominantly  from  state  two  (radar  in 
use)  to  state  one  (optics  in  use). 

The  above  events  were  expected.  The  system  transitions  from  major  state 
three  into  major  state  two  whenever  tracking  errors  go  out  of  bounds.  And  given  that 
the  subjects  generally  monitor  the  radar  scope  prior  to  blanking,  the  above  mentioned 
data  simply  Indicate  that  the  tracking  errors  would  occasionally  go  out  of  bounds 
before  the  angle  operator  could  switch  from  the  radar  display  to  the  optics  after 
the  onset  of  blanking. 
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There  was  little  decision  activity  In  acquisition  states  other  than  that 
mentioned  above. 

Decision  activity  while  tracking  (major  state  three)  centered  around  inputs 
four,  seven,  and  to  some  degree  eight.  Input  four  applied  after  the  onset  of  blank- 
ing, but  before  the  errors  went  out  of  bounds,  "nie  data  in  Table  10  indicate  that 
the  subjects  were  able  to  make  certain  decisions  in  response  to  the  blanking  events 
before  the  tracking  state  was  lost.  Inputs  seven  and  eight  are  the  normal  operating 
states  with  range  in  or  out  of  bounds.  Some  small  amount  decision  activity  was 
exhibited  by  the  angle  operators  when  the  angle  errors  were  in  bounds,  but  range 
was  out  of  bounds. 

Description  of  Transition  Probability  Matrices 
and  Time  in  State  Statistics 

Table  11  contains  selected  transition  probability  matrices  for  the  angle 
operator  activity  states  for  major  states  two  and  three  (acquisition  and  track).  A 
summary  of  the  number  of  times  each  state  was  entered  and  the  number  of  trans- 
itions  from  each  state  is  also  provided.  Matrices  for  acquisition — major  state  two — 
contain  only  zeroes  and  over  because  only  two  states  were  used  (radar  and  optics) 
and  hence  all  transitions  must  be  deterministic.  Matrices  are  included  only  for 
those  inputs  which  exhibited  some  decision  activities.  j 

Matrices  for  major  state  three  exhibit  some  interesting  behaviors.  The 
transition  from  state  five  into  state  one  shown  in  P(3, 1)  reflects  the  change  from 
mode  two  to  m ode  one  before  the  target  appears.  The  fact  that  there  were  so  few 
transitions  shows  that  the  search  state  was  typically  entered  before  the  mode  switch 
was  made. 
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P(3,  2)  illustrates  activities  for  those  few  cases  In  which  both  displays  were 
blanked  during  tracking.  Subjects  transitioned  from  manual  control  to  auto,  made 
display  switches,  and  also  transitioned  from  auto  to  manual.  TTiere  is  not  suffic- 
ient data  to  draw  many  conclusions. 

P(3, 4)  is  more  instructive.  This  matrix  applies  when  the  radar  is  blanked 
and  the  tracking  errors  are  in  bounds.  First  of  all,  the  presence  of  zeroes  for 
states  five,  six,  seven,  and  eight  is  an  indication  that  mode  two  was  not  used.  The 
first  row  indicates  that  most  transitions  from  state  one  (manual  control,  radar 
display)  were  to  state  two  (manual  control,  optics)  with  some  to  auto  track.  Most 
transitions  from  state  two  were  back  to  state  one,  with  some  to  auto  track.  Trans- 
itions from  state  four  were  somewhat  different  in  the  sense  that  most  transitions 
were  from  auto  to  manual  and  not  a change  in  display. 

From  the  time  in  state  summary  shown  in  Table  12,  a few  additional  insights 
are  obtained.  The  time  in  state  averages  range  from  about  one  second  to  about  one 
and  one-half  seconds  for  all  states  except  state  three,  i.  e. . for  3,4, 1;  3, 4,  2; 

3, 4, 4 times  ~ 1. 5 seconds.  State  3, 4, 3 which  would  be  the  expected  state  just 
after  blanking  is  occupied  for  only  . 7 seconds  after  blanking.  The  operator  goes  to 
a manual  control  state  or  a new  display  quite  quickly  after  onset  of  the  blanking. 
These  times  agree  quite  closely  with  those  for  the  acquire  state. 

Matrix  P(3, 6)  is  interesting  in  the  sense  that  it  shows  what  happens  when 
the  mode  two  mistake  is  made  and  errors  drift  out  of  bounds.  Here,  the  auto  track 
button  has  been  set,  but  because  of  the  operator  error  the  system  is  not  tracking. 
Recall  that  in  mode  two,  the  angle  operator  must  continue  to  track  after  the  auto 
track  button  is  set.  Transitions  from  state  seven  are  generally  to  state  three 
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(switch  from  mode  two  to  mode  one)  but  on  15  percent  of  the  few  transitions  which 
occurred  there  was  a switth  in  display.  The  time  in  state  was  also  quite  long, 
about  1.5  seconds,  indicating  some  confusion  when  this  state  occurred. 

Matrix  (P3, 7)  is  the  "normal  activity"  case.  As  above,  there  is  some 
mode  switch  behavior  apparent  here.  Note  that  in  most  cases  in  which  state  five 
was  occupied  (mode  two,  manual,  radar)  the  transition  was  to  state  seven,  (mode 
two,  auto,  radar)  and  in  only  four  percent  of  the  cases  did  the  operators  realize 
the  mode  setting  error  and  transition  to  state  one.  Once  state  seven  was  occupied, 
the  transitions  were  almost  always  to  change  mode.  Transitions  from  states  one 
and  two  were  almost  always  to  states  three  and  nine,  respectively.  Indicating  a 
change  from  manual  to  automatic  control.  Transitions  from  states  three  and  four 
were  to  states  four  and  three,  respectively,  indicating  switches  in  display  but  not 
in  control.  Once  auto  track  was  achieved,  the  system  stayed  there. 

The  time  in  state  information  for  major  state  three,  input  seven,  states  one, 
two,  three,  and  four  is  quite  informative.  (3,  7, 1)  (3,  7,  2)  were  each  occupied 

for  about . 5 seconds  before  a transition  was  made,  but  (3,  7,  3)  was  occupied  for 
an  average  of  2. 5 seconds  with  a variance  of  23.  81  seconds  . Since  (3,  7, 3)  is  the 
most  common  state,  one  should  expect  a higher  mean  time  in  state,  but  the  high 
variance  is  interesting.  One  could  reasonably  conjecture  that  the  time  in  state 
distribution  is  probably  bimodal  and  there  are  two  phenomena  going  on  here.  For 
example,  behavior  in  this  state  might  be  quite  different  before  and  after  blanking 
since  the  subjects  knew  the  target  would  not  be  blanked  a second  time.  They  might 
be  more  willing  to  use  the  optics  once  the  target  had  been  reacquired  after  blanking 
and  hence  would  have  reduced  times  in  the  mode  one  radar  tracking  state. 
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The  large  variances  in  state  (3,  7,  4)  are  interesting  from  the  same  perspec- 
tive. More  definitive  answers  as  to  why  these  occurred  must  await  more  complete 
analysis  of  the  distribution  of  times  in  state.  Such  an  analysis  is  being  performed 
at  the  time  of  this  writing. 

P(3,  8)  is  similar  to  P(3,  7)  in  many  respects.  TTie  main  difference  is  that 
input  eight  did  not  occur  during  a manual  control  activity.  Transitions  were  deter- 
ministic in  the  few  cases  observed  and  most  transitions  were  changes  of  display. 
There  were  also  a few  instances  in  which  mode  two  to  mode  one  switches  were 
made. 

It  was  felt  that  because  of  some  possible  problems  with  the  range  error  data 
that  true  indications  of  inputs  seven  and  eight  were  not  obtained  in  the  above  analysis. 
It  appeared  from  inspection  of  the  raw  data  that  there  were  many  more  changes  of 
input  from  seven  to  eight  and  back  to  seven  than  should  have  been  the  case.  To  get 
some  feel  for  the  sensitivity  and  to  determine  if  data  problems  might  be  confounding 
these  results,  another  analysis  was  performed.  For  this  analysis,  inputs  seven  and 
eight  were  collapsed  essentially  eliminating  range  error  as  an  input.  The  results 
are  presented  in  Table  13.  There  is  no  significant  change  in  the  transition  proba- 
bilities nor  in  the  average  time  in  state.  The  variance  of  the  time  in  state  increased 
substantially,  however.  This  seems  to  indicate  that  range  error  problems  did  not 
seriously  impact  the  probability  estimates  and  time  in  state  estimates.  Furthermore, 
this  analysis  lends  some  support  to  the  hypothesis  that  misclassification  of  inputs  will 
show  up  in  terms  of  inflated  variances  and  perhaps  bimodal  time  in  state  distributions. 

Tables  14  through  17  contain  the  transition  probabilities  for  ii^iuts  four,  seven, 

and  eight  computed  for  individual  teams.  With  respect  to  input  four  there  is  little 
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difference  between  the  teams.  The  biggest  difference  seems  to  be  that  teams  three 


and  four  tended  to  transition  from  state  two  to  state  one  whereas  the  others  trans- 
itioned to  state  four.  That  means  that  tu'o  teams  tended  to  switch  from  manual  to 
auto  control  before  making  a display  change  whereas  the  other  teans  did  the  oppo- 
site. Either  strategy  is  probably  effective. 

With  input  seven  the  teams  differed  only  in  their  degree  of  variability.  The 
general  tendencies  were  the  same.  Teams  one  and  three  did,  however,  exhibit 
the  mode  two  error  more  often  than  tearts  two  and  four.  Under  input  eight  the  only 
differences  between  teams  were  the  mode  two  errors  mentioned  above.  Teams  one 
and  three  appear  to  have  used  a much  more  systematized  procedure  and  seldom 
were  caught  in  mode  two. 

For  this  data  at  least,  there  appears  to  be  no  reason  why  aggregating  data 
across  teams  should  cause  problems. 

Tables  18  through  24  contain  the  state  transition  matrices  aggregated  across 
teams,  but  by  individual  target  trajectories. 

There  is  insufficient  data  to  make  rigorous  comparisons,  but  there  does  not 
appear  to  be  much  difference  across  trajectories  for  input  four.  That  is,  when  the 
display  was  blanked  the  subjects  tended  to  do  pretty  much  the  same  things. 

With  input  seven  the  results  are  consistent  across  trajectories  with  the  pos- 
sible exception  of  state  one  on  trajectory  four.  Here  there  was  somewhat  more 
variability  with  more  switches  from  radar  to  optics  prior  to  a switch  from  manual 
control  to  auto  control  than  occurred  on  other  trajectories.  The  sample  size  is  not 
large  enough  to  place  much  importance  on  this  result,  however. 
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Behaviors  across  trajectories  with  input  eight  did  not  vary  with  the  exception 
that  input  eight  did  not  occur  on  trajectory  ten. 

In  general,  the  observed  behaviors  were  independent  of  team  and  trajectory. 

Given  the  simplicity  of  the  tasks,  however,  and  the  training  received,  this  should 
not  be  unexpected.  The  aggregated  data  is  therefore  the  best  characterization  of 
the  results  of  the  experiment. 

It  should  also  be  noted  that  in  every  case  tests  of  the  hypothesis  that  the 
system  was  of  order  one  versus  order  two  resulted  in  the  failure  to  reject  the  null. 

For  this  experiment  at  least,  first  order  processes  were  sufficient  to  represent  the 
data. 

DC.  Conclusicns 

* • 

It  has  been  demonstrated  that  finite  state  models  of  human  operators  perform- 

i 

ing  discrete  control  tasks  can  be  constructed  and  parameters  estimated  from  data. 

The  methods  designed  in  this  research  have  been  successfully  applied  to  data  ob- 

i • 

tained  from  a man-in-the-loop  simulation.  Differences  in  behavior  under  different 
environmental  inputs  have  been  successfully  defined  and  parameterized  using  the 
methods  developed. 

A major  concern  with  this  approach  was  the  availability  of  sufficient  data. 

Although  there  were  several  input-state  combinations  which  were  not  sufficiently 
activated  during  the  simulation  to  provide  appropriate  data,  those  which  were  ex- 
plicitly considered  in  the  design  of  the  experiments  produced  useful  data  even  when 
the  desired  number  of  trials  was  cut  by  more  than  50  percent.  It  appears  that  the 
method  can  be  successful  if  the  experimental  tasks  contain  sufficient  variety  to 
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activate  the  states  and  behavior  of  interest.  This  is  particularly  important  if  the 
distributions  of  time  in  state  is  required. 

Another  observation  relevant  to  the  design  of  experiments  can  be  made  on 
the  basis  of  this  study.  The  tasks  in  the  experiment  studied  here  were  quite  pre- 
dictable. For  example,  the  subjects  knew  the  target  would  be  blanked  only  once 
during  a given  run.  This  had  the  effect  of  producing  some  artificial  behavior  and 
trapping  states  in  the  model  (states  which  once  entered  were  not  exited).  Certain 
other  modes  were  simply  not  used  (mode  two).  These  conditions  can  be  eliminated 
in  future  experiments. 

In  terms  of  the  methodology,  the  most  encouraging  result  is  that  the  use  of 
task  dependent  hierarchical  decompositions  of  the  finite  state  model  appears  to 
defeat  the  combinatorial  problem  of  a large  number  of  internal  model  states  and 
appears  also  to  be  identifiable  from  data.  The  processing  of  raw  tracking  data  from 
experiments  is  quite  expensive  at  this  point,  but  with  better  prior  characterizations 
of  the  model  inputs  this  defect  can  be  remedied. 

A Iso  in  terms  of  the  methodology,  it  appears  that  time  in  state  information 
may  also  provide  clues  indicating  possible  misclassification  of  inputs.  The  defini- 
tion of  inputs  is  to  some  degree  the  most  ad  hoc  step  in  the  entire  procedure.  The 
development  of  empirical  tests  of  the  adequacy  of  a given  set  of  input  classifications 
must  be  developed.  Sensitivity  analyses  can  be  performed,  but  they  are  enormously 
expensive  with  this  type  of  data.  More  direct  tests,  such  as  the  homogeneity  of  time 
in  state  data,  are  needed  and,  based  on  the  results  of  this  analysis,  appear  very 
possible. 
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In  summary,  the  major  theoretical  and  methodological  hurdles  have  been 
overcome.  A number  of  procedures  must  be  refined  and  made  more  efficient, 
but  we  do  now  have  the  capability  to  identify  finite  state  models  of  human  oper- 
ators from  data. 
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APPENDIX  1 


OUTPUT  TRANSITION  PROBABILITIES 
Let  us  examine  a Markov  chain  which  has  N states  ^ Fj,  . . , , Fj^  ] , and 


a transition  matrix 


There  are  K different  outputs  ^ O,, . . . , O 1 . Output  O.  is  realized  when  the 

IK  1 

state  of  the  underlying  Markov  chain  is  ^F.-  , . . . F.  ? . The  initial  state  distri- 

^ 1 % 

button  (rf  the  Markov  chain  is  n = { 11  , 11  ^ , its  distribution  at  time  t 

0 0 ’ 0 

is  n = P*. 

t 0 

Definition  1.  A,.(0_)  is  defined  to  be  the  transition  probability  of  going  from  state  i 

ij  s 

to  state  j,  when  the  output  resulting  from  state  j is  O . 

s 

Theorem  1.  The  transition  matrix,  when  the  output  at  time  t is  Og  is 


A(0^)=  . 


Si  S2  SKg 

• • • ® ^ISj  0 • • • 0 Pisg  ^ISj^  0 ...  0 


0 0 0 ...  0 P-, 

NSj^  NSj^ 


0 ...  0 


Proof . niis  is  clear  as  the  new  state  has  to  have  output  Og  and  only 
^^slj  * * * ’ ^sKs^  ~ output  Og.  So  Py  is  nonzero  if  and  only  if  j 6 Fg  , 

and  then  Ay  = Py,  where  { Py  ] is  the  transition  matrix  of  the  underlying  Markov 
chain. 
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Theorem  2.  The  probability  of  an  output  sequence  0(1)  = q^,  0(2)  = qg, . . . , 0(tQ)  = q^ 

o 

is  given  by: 

P(0(1)  = Qi.  0(2)  = q2,...,0(tQ)  = " nQA(qi)  • A(q2)  ...  A(qj^)  e, 

where  e*  = (1, 1, ... , 1). 

Proof. 

P(Oa)  = qj,  0(2)  = q2. . . . , 0(1^)  = q^  |n  ) 

0 

= P(0(1)  = qj  I Hq)  F(0(2)  = qzl  0(1)  = q^.  Hq) 

...  P(0(tQ)  = q^^l  0(1)  = qj ^0^ 

= P(0(1)  = qj(n^j)  P(0(2)  = q2lO(l)  = q^)...  P(0(to)  = qj^|0(t^j-l)  = q^ 

0 ^ 1^^ 0/ 

A 

gives  the  probabilily  starting  in  state  i at  t = 0 and  having  the  above 
outputs,  Vi.  A e then  gives  the  total  probability  of  having  the  above  outputs, 
starting  in  any  state. 

It  is  possible  that  one  may  not  be  able  to  observe  the  underlying  Markov 
chain,  but  only  the  outputs.  One  might  then  assume  that  a system,  whose  state  is 
(0(t-l),  0(t))  is  Markovian. 

Definition  2.  qj.(t)  = P((0(t),  0(t-l)  = (jj,  jg)  1 (0(t-l),  0(t-2))  = (ij,  i^),  where 
(ij.  I2)  = (ii.  iz)  = j*  Note  qjj(t)  = 0 if  i2  ^ jj. 

The  transition  matrix  for  the  second  order  output  system  is  of  the  form: 


OjOj. . . OiOjj020j. . .020j^ 


OiOi 


Q(t)=[qjj(t)]  = 


^1*  • • °nPn 


Theorem  3.  The  Q matrix  is  time  dependent. 

Proof.  Assume  Fs  - T F;  . F F.  ^ Rive  output  O.  . 

1 ^ ‘l 

4 

Fi  , F.  , ....  Fj  ] give  output  O.  -O  , 

2 2 2„  2kj  2 

1 ^ 2 

and  F ={f.  , F , ....  F.  ] give  O.  . 

^2 


K 


U 


Tlien 
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q..(t)  = P(0(t)  = |0(t-l)  = ij,  0(t-2)  - ig  ) 


= P(F(t)  e F I F(t-1)  e F.  , F(t-2)  e F.  ) 

h *1  ‘2 

kj  k k 

2 h h 

= 222  P(F(t)  = F I F(t-1)  = F . F(t-2)  = F ) 

i=l  j=l  k=l  % h.  \ 

!•  J i 


• P(F(t-l)  = F , F(t-2)  - F I F(t-1)  e F.  , F(t-2)  e F ) 
^*1 


P(F(t-l)  = Fj  , F(t-2)  = Fj  ) 

li  ^2. 


= 2 S 2 P 

i j k ij  .Jo  P(F(t-l)€F  , F(t-2)eFj  ) 

J ^ *1.  2 


So  the  transition  matrix  for  a second  order  output  system  is  time  dependent, 
for  all  values  of  t. 

Corollary.  Ihe  transition  matrix  for  an  n-th  order  output  system  is  time  dependent 
for  all  values  of  t. 

Proof,  This  can  be  proved  in  exactly  the  same  manner  as  theorem  3. 
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Lemma.  If  |E.(tQ-l)  1 - A.  then  | E^Ito)  1 max 

where  A.  Is  the  maximum  eigenvalue  of  the  matrix  P. 

" max 

tfl-l 

Proof>_  Ei(to-l)  " J ^ ^ 

V * V =:  V a = £ a A.  0 ^ \ 

^i^O^  ^ ®n^n  jj  n n n 

- I ^ Vax  " ^ Vax 

This  is  true  because  all  the  eigenvalues  are  positive  between  0 and  1. 


Definition  3.  r\  nit)  ~ max  | 


Lemma  2.  | 


Proof.  Trivial. 


Definition  4.  ^^(t)  - min 


Note  Ti(t)  = max  ( lKjj(t)  |,  lKj(t)  | ) 


max  

ifFj  ^i 
1 


Lemma  3. 


Proof. 


A + B(t)  1 + KQ(t) 


A + B(t)  1 + B(t)/A  1 + KQ(t) 

2ri  (t-2) 

Theorem  5.  qy(t)  “ f | ^jk  ^ij^  ^ ^ l+KQ(t-2)  ^ 

Proof,  Clear  from  lemmas  3 and  4. 
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Corollary  2.  For  an  n-th  order  output  system  one  has 


Qi  i (t)  ^ > 

1 ‘n 


i>  ...i>  ^ 

‘2  Hi  V2  Vs  ‘n-l*‘n  A+R(t-2)  1 II  ^ A 


where  A = ^ n.  P . p , as 

il  in-l  1 ^1^2  in-2*^n-l 


B(t)  = S...  Z E,  (t)  Pj  j ...  P. 

h in-1  1 1 2 V-2’  ^n-1 


and  P(F(t)  = i)  = n +E(t)  — ► n. 

1 1 00  1 


Proof.  Hiis  is  obtained  In  a similar  manner  as  theorem  5. 


2 T1  (0) 

£ 1 =^2  Ti  (0)  s (1  + K„(0)  )^2. 

l+Ko(0) 
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A COMPUTATIONAL  EXAMPLE 

The  system  to  be  examined  can  be  modeled  by  a first  order  Markov  chain 
with  transition  matrix  Q.  llie  state  space  is  ( 1,  2,  3,  4,  5,  6 } . 
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States  1 and  2 are  assumed  to  give  output  A,  states  3 and  4 give  output  B,  and 
states  5 and  6 give  output  C.  Q was  used  to  simulate  the  system  transitions  for 


1000  time  units.  Assuming  the  output  transitions  can  be  modeled  by  a first  order 
Markov  chain,  the  transition  count  for  that  chain  is  Nj^. 


Ni  = 


A 

B 

C 

223 

114 

112 

A 

129 

61 

108 

B 

96 

124 

34 

C 

Maximum  likelihood  estimates  of  the  transition  probabilities  were  developed. 


The  transition  matrix  is  P, 


0.49666 

0. 25390 

0. 24944  ' 

= 

0. 43289 

0. 20470 

0.  36242 

0. 37795 

0. 48819 

0. 13386 

i 

From  N]^,  a maximum  likelihood  estimate  of  the  transition  matrix  Q of  the 
state  system  is  developed. 
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1 

J 


0. 2485 

0. 2485 

0. 1270 

0. 1270 

0. 1245 

0. 1245 

0. 2485 

0. 2485 

0. 1270 

0. 1270 

0. 1245 

0. 1245 

0. 2165 

0. 2165 

0. 1025 

0. 1025 

0.1810 

0.1810 

0. 2165 

0. 2165 

0. 1025 

0. 1025 

0. 1810 

0.1810 
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0.1890 

0. 2440 

0. 2440 

0. 0670 

0. 0670 
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Q is  then  used  to  simulate  the  system  and  the  ou^ut  transitions  are  modeled  with 
a Markov  chain.  The  transition  count  for  the  outputs  is 


242 

108 

108 

132 

75 

99 

84 

123 

29 

From  this  a maximum  likelihood  estimate  of  the  output  transition  matrix  is 
developed. 


= 


0. 52941 
0. 43137 
0. 35593 


0. 23529 
0. 24510 
0.  52119 


0. 23529 
0. 32353 
0. 12288  _ 


The  null  hypothesis  that  Nj  comes  from  Pj  can  be  tested  against  the  alter- 
native hypothesis  that  it  comes  from  Pj 

^P 

X = max  ^ = 0.038 

Is  is  known  that 

-2  In  X - X ^ 

3 

-2  In  X = 6.  5 


Xg  (0.  05)  = 7.  81 


[I.  i 


So  we  accept  the  null  hypothesis.  Therefore  one  can  not  say  that  Nj  could  not 


have  been  generated  by  Pj. 

Now  let  us  assume  that  the  output  transitions  cannot  be  modeled  with  a 
first  order  Markov  chain,  but  it  can  be  modeled  by  a second  order  Markov  chain. 
The  transition  for  the  second  order  output  system  is  N2. 
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From  Ng,  maximum  likelihood  estimates  of  the  second  order  output  transition 


probabilities  are  developed.  The  transition  matrix  is  P2 


P 


2 


0. 52335 
0.41228 
0.35714 
0.58140 
0. 38333 
0.42593 
0.36458 
0.47581 
0.29412 


0. 26009 
0. 14035 
0. 55357 
0. 20155 
0.31667 
0.38889 
0.31250 
0. 20968 
0. 58824 


0. 23767 
0. 44737 
0. 08929 
0.21705 
0. 30000 
0.18519 
0. 32292 
0.31452 
0.11765 


From  Ng, 


A 

Q2  a mixximum  likelihood  estunate  of  the  second  order  transition  matrix 


of  the  underlying  system  can  be  developed.  Q2  is  then  used  to  simulate  the  system. 


Tbe  output  transitions  are  modeled  with  a second  order  Markov  chain.  Ibe  trans- 


ition count  for  the  output  is 
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21 
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From  this  P2  a maximum  likelihood  estimate  of  the  output  transition  matrix  is 
developed. 


0. 55859 
0.43396 
0. 36609 
0. 59843 
0.36066 
0.41837 
0. 40000 
0. 50000 
0. 26667 


0. 23047 
0.17925 
0. 54464 
0. 20472 
0. 29508 
0. 39796 
0. 23333 
0. 20000 
0. 66667 


0.21094 
0. 38629 
0. 08929 
0. 19685 
0. 34426 
0. 18367 
0. 36667 
0. 30000 
0.  06667 


The  null  hypothesis  that  Ng  comes  from  can  be  tested  against  the  alter- 
native hypothesis  that  it  comes  from  P2 


A.  = max 


= 0.3546 


It  is  known  that 


-2  ln\  o: 


-2  1n\  2.07<  X (0.05)  = 11.4 

9 

So  we  accept  the  null  hypothesis.  TTierefore,  one  can  not  say  that  Nj  could 


not  have  been  generated  by  Pg. 
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The  first  order  output  transition  matrix  generated  by 


Q2  is 


£ 


0. 54008  0. 22363  0. 23629 

0.44599  0.21254  0.34146 

0. 37500  0. 50000  0. 12500 


If  one  tests  the  null  hypothesis  that  came  from  against  the  alternative 


hypothesis  that  it  came  from  P^. 

max  Lp 

X = = 0.104 

max 


-2  In  X =1  2.  26  < (0.  05)  = 7.  8) 

«5 

* 

So  Pj  is  preferred  to  P^. 

From  those  results  the  following  statement  can  be  made: 

If  one  can  only  observe  the  outputs  of  a system,  but  not  the  real  states, 
the  output  transitions  can  be  modeled  as  a Markov  chain.  A transition  matrix  can 
be  developed  and  from  this  matrix  a transition  matrix  of  the  underlying  system 
can  be  inferred.  Then  one  cannot  reject  the  hypothesis  that  the  output  sequence 
generated  by  the  real  system  was  generated  by  the  inferred  transition  matrix. 
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APPENDIX  3 


ESTIMATION  OF  TRANSITION  PROBABILITIES 
The  problem  to  be  examined  here  is  the  estimation  of  transition  probabilities 
for  a finite  state  Markov  ehain.  The  state  of  the  chain  at  time  t is  defined  to  be  a 
two  dimensional  vector  S(t)  = (I(t),  F(t)  ),  where  I(t)  is  an  input  to  the  system  at 
time  t and  F (t)  is  the  state  of  the  system  at  time  t. 

One  is  interested  in  the  probability  that  the  state  of  the  chain  is  S^  at  time  t 
given  it  is  past,  or: 

P(S(t)  = Sj  (S(t-1)  = S^_i, . . . , S(0)  = Sq).  (1) 

Under  the  assumption  that  the  system  can  be  represented  by  a first  order 
Markov  chain,  (1)  reduces  to 

P(S(t)  = Sj(S(t-l)  = St_i),  (2) 

if  Sj  = (i,  m)  and  Sj_j  = (j,  n),  (2)  can  be  written  as 

Pimjn  = P(F(t)  = j,  I(t)  = n I F(t-1)  = i,  I(t-1)  = m).  (3) 

Let  us  assume  that,  l^i,j^N,  1— n,m  — K.  Then  there  exists  a mapping  X which 
maps  the  two  dimensional  state  vector  (i,  m)  into  a one  dimensional  state  vector  (g), 
X(i,  m)  = m • N + i = g.  (4) 

Let  us  assume  X(S(t)  ) = G(t),  then  (3)  is  equivalent  to 
Pgn  = P(G(t)  = h I G(t-1)  = g), 
when  X(i,  m)  = g and  X(j,  n)  = h. 

Now  Pg„  can  be  estimated  using  the  known  theory  of  estimation  of  transition  prob- 
abilities for  a Markov  chain.  Hiis  theory  is  developed  in  a paper  by  Anderson 
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and  Goodman  (1). 


J realizations  of  the  system  transitions  are  observed.  ITie  transition  count 
I ght  ’ number  of  transitions  from  g to  h at  time  t, 

(G(t-l)  = g,  G(t)  = h).  Realization  j is  observed  for  t^+l  time  units  starting  at 
time  0.  Tlie  total  number  of  observations  made  at  time  t is  M(t);  thus 


"gh^>  " ® 

The  maximum  likelihood  estimate  of  P . is 

gn 


^gh 


max 

S n j^(t) 
t=l  ^ 

^ ^ax 
S S n . (t) 

h-1  t=l  S'* 


. V g.h 


(5) 


Now  one  is  mainly  interested  in  = P(F(t)  = j | F(t-1)  = i,  I(t-1)  = m),  the 

probability  that  the  state  of  the  system  changes  from  i at  time  t-1  to  j at  time  t 
given  an  input  m at  time  t-1. 

Keeping  (2)  shows  that  if  0 is  a maximum  likelihood  estimate  of  0 and  f 
is  a continuous  function,  then  the  maximum  likelihood  estimate  of  f (0)  is  f(9). 

It  is  clear  that 

K 

^imj  ~ 1^1  '^(i+Nm)(j+NK)’  ^ j “ 1-m^K, 

therefore  the  maximum  likelihood  estimate  of  P.  . is  i 

im]  I 

K ^ I 

^imj  ~ ^(i+Nm)(j+NK)  ^ j “ N*  1 - K.  (6)  j 

When  one  does  not  know  with  certainly  the  correct  order  of  the  Markov  i 

chain  under  study,  one  is  interested  in  testing  the  null  hypothesis,  that  the  chain 
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is  of  order  K,  against  the  alternative  hypothesis,  that  its  order  is  K + 1. 


If  K - 1,  the  transition  probabilities  assuming  the  null  hypothesis  is 


true,  are 


P_j.  = P(G(t)  = h I G(t-1)  = g),  Vg,  h. 


If  the  alternative  hypothesis  is  true,  the  transition  probabilities  are 


Pfgh  = P(G(t)  = h I G(t-1)  = g,  G(t-2)  = f)  V f,  g,  h . 

A 

The  maximum  likelihood  estimate  of  P^gj^  is  of  the  same  form  as  P^j^. 


S n (t) 

b = t-2 

NK  t^ax 

S S nj  j^(t) 

h=l  t=2 


, V f,  g,  h. 


where  n,  , (t)  is  the  number  of  realizations  which  occupied  state  f at  t-2,  state  g 
fgh' 

at  time  t-1,  and  state  h at  time  t.  Then  it  has  been  shown  that  -2  log  X has  an 
2 2 

asymptotic  X distribution  with  NK(NK-l)  degrees  of  freedom,  where 


NK  NK  NK  / P 

n n n — 

f=i  g-i  h-i  i>f 


TTiis  generalizes  to  K > 1,  very  easily. 
As  one  is  mainly  interested  in 


*max 

S n (t))  (8) 

t=2  ® 


Pimj  = Pgj  = = j I ^ 


= P(F(t)  = j I G(t-1)  = g) 


one  would  compare  (9)  to 


Pfeh  = P(F(t)  = j I G(t-1)  = g.  F(t-2)  = f). 


-2  log  ^ then  has  an  asymptotic  distribution  with  NK(NK-1)(N-1)  degrees 


of  freedom,  where 


NK  NK  NK  / P . \ "fgj 

A.  = n n n 


f=i  g=i  j=i  \ Pfgj 


Having  obtained  estimates  of  the  transition  probabilities,  it  is  desirable  to 

construct  confidence  intervals  around  those  estimates.  It  is  known  that  P , is 

gn 

asymptotically  normally  distributed  with  the  following  second  order  moments. 


^(Pgh)  = Pgh 

1 

Var  (Pg,^)  = - 


'’gh^l  - Pgh) 


NK  ^nax 
2 2 

g=l  t=l 


Cov  (Pgh,  P^g)  = 


■ ^gh  ^gs 


if  g = r. 


otherwise. 


From  this  one  obtains  the  moments  of  P 


E(P„)  = P 1 
' gj'  gj 


Var(Pj))  = v«r(  S ) = 2 Var  (Pgy„)) 

m=l  n-l 

r/  8 
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The  central  limit  theorem  then  gives  a (1  - a)  x 100% confidence  interval  of 


Pgjas 


(Pgj  i Z, 


a/2 


f 


var  (P 


SJ 


) ). 
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APPENDIX  4 


I’ROTOCOL 

A.  Objectives 

1.  Determine  the  degree  to  which  subjects  can  perform  discrete 
control  tasks  on  the  simulator  apparatus. 

2.  Determine  the  input  characteristics  required  to  induce  subjects 
to  execute  discrete  control  options  during  a run. 

3.  Provide  data  for  testing  discrete  control  model  parameter 
estimation  algorithms. 

4.  Provide  data  for  preliminary  analysis  of  relationships  between 
system  mode  of  operation,  target  trajectory,  control  configfura- 
tion  and  information  channel  configuration. 

5.  Evaluate  alternative  scoring  metrics  for  assessing  discrete 
control  performance. 

B.  Background 

Previous  manual  control  studies  have  emphasized  continuous  tracking  of 
azimuth,  elevation  and  range.  This  study  is  concerned  with  an  entirely  different 
set  of  information  processing  and  control  activities,  namely,  how  operators  con- 
figure the  system  under  their  control  and  how  they  utilize  available  input  informa- 
tion channels.  It  is  the  first  step  in  modeling  the  supervisory  control  decisions 
and  the  corresponding  coordinating  information  flows  in  a multilevel  man-machine 
system. 

C.  Relevance 

This  experiment  is  basically  a pilot  study  which  serves  to  further  clarify 
the  modeling  issues  in  the  discrete  control  problem.  The  data  provided  will  serve 
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to  test  parameter  estimation  algorithms  and  provide  statistical  information  for 
better  experimental  design. 

Ultimately  discrete  control  experiments  will  produce  data  and  models 
which  can  be  used  to  enrich  threat  quantification  models  through  incorporation  of 
the  resource  management  and  system  configuration  decisions. 

D.  Experimental  Plan 

1.  Apparatus 

The  dynamics  of  the  simulator  are  designed  to  represent  the  following  : 

AAA  functions: 

I • 

a.  Use  of  left  hand  optics  slaved  to  the  radar  antenna. 

■ • 

b.  Use  of  the  PPI  scope  for  angle  tracking  by  radar. 

c.  Use  of  A scope  for  range  tracking.  i. 

d.  Use  of  sector  scan,  circular  scan  and  fast  circular  scan 

radar  modes  for  target  detection  and  acquisition.  i . 

e.  Manual  azimuth,  elevation  and  range  tracking. 

L . 

f.  Manual  azimuth,  elevation  tracking  with  automatic  range 
tracking  (mode  2). 

g.  Automatic  azimuth,  elevation  and  range  tracking  (mode  1). 

2.  Subjects 

A total  of  12  trackers  will  be  used  for  this  study.  Subjects  will  be  used  in 
pairs,  one  tracker  serving  as  range  operator,  one  as  the  angle  operator. 

Ihe  subjects  are  male  and  female  ranging  in  age  from  18  to  25  years. 

Their  vision  is  20/20  and  they  may  wear  corrective  lenses  to  insure  this. 

They  receive  monetary  payment  for  time  spent  tracking  during  experiments 
and  during  training. 

Although  the  trackers  vary  in  their  proficiency  with  tracking  devices,  all 
will  be  trained  to  an  acceptable  level  of  performance  as  determined  by  the 
training  supervisor  and  principal  investigator.  Given  the  lack  of  experience 

t 
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with  discrete  control  tasks  during  tracking,  it  is  not  clear  that  a single 
measure  can  be  used  to  assess  proficiency,  but  minimum  performance 
must  include  the  following 

a.  Acquisition  of  the  target  on  all  trajectories  within  30  seconds 
of  target  introduction. 

b.  Enter  auto  track  mode  on  all  trajectories. 

c.  Ability  to  use  mode  1 on  all  trajectories. 

d.  Ability  to  switch  from  optical  to  radar  input  upon  blanking 
of  screen  (angle  operator). 

e.  Switch  from  radar  to  optical  input  upon  loss  of  radar  return. 

f.  Detect  loss  of  auto  track,  reacquire  target  and  reinitialize 
auto  track. 

During  training  the  trackers  are  free  to  use  either  eye  for  optical  angle 
tracking  and  may  select  any  magnification  or  filter  in  the  optical  system. 
The  angle  operator  may  select  any  control  configuration  and  any  radar 
configuration  (sector  scan,  fast  circular  scan,  circular  scan).  The 
range  operator  may  also  select  any  control  configuration.  Subjects  should 
be  encouraged  to  exercise  all  discrete  control  options  and  completely 
familiarize  themselves  with  the  capabilities  of  the  system.  During  the 
early  phases  of  training  the  trajectories  should  not  be  varied  from  run 
to  run.  Teamd  should  practice  on  a given  trajectory  until  performance 
is  acceptable.  When  all  trajectories  have  been  mastered  with  no  blanking 
of  the  displays  or  disruption  of  auto  track,  blanking  should  be  introduced 
on  the  radar  displays  and  optical  displays  on  about  one  half  of  the  practice 
runs  in  the  training  session.  Optical  blardcing  and  radar  blanking  should 
not  be  performed  on  the  same  run.  When  subjects  have  attained  an  accept- 
able level  performance  on  this  task  when  the  trajectory  is  known  before- 
hand, all  ten  trajectories  should  be  used  in  a given  training  session, 
randomly  ordered  and  with  randomly  placed  blanking  of  the  displays.  That 
is  the  format  of  the  actual  experiment  should  be  used.  Mode  1 and  mode  2 
settings  should  be  randomly  made  at  the  beginning  of  each  run. 

Trackers  will  require  approximately  4 weeks  for  training.  They  will  be 
utilized  for  a period  of  20  days  for  data  collection.  Each  team  will  be  used 
for  approximately  45  minutes  each  during  both  training  and  data  collection 
for  the  experiment.  Each  45  minute  session  will  involve  tracking  20  trajec- 
tories, each  of  which  is  approximately  60  seconds  in  duration.  Appropriate 
rest  periods  will  be  given  between  trajectories. 
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3.  Design 

During  the  experiment  there  will  be  ten  different  trajectories  administered 
for  the  subjects  to  tracit.  The  trajectories  are  described  in  Table  1. 

These  trajectories  are  the  same  as  trajectories  used  in  previous  tracking 
studies  with  the  exception  that  20  seconds  of  straight  and  level  flight  have 
been  concatenated  to  the  beginning  of  each  trajectory  to  accomodate  de- 
tection and  acquisition  of  the  target. 


The  following  variables  will  be  recorded  during  the  experiment: 

a.  Manual  notes: 

Trackers'  comments  on  strategy  used. 

Experimenter's  observations. 

Training  supervisor's  observations. 

b.  Automatic  data  acquisition: 

Tracking  data: 

Target  trajectory  including  azimuth,  elevation, 
range,  roll,  pitch  and  yaw. 

Azimuth  tracking  error 

Elevation  tracking  error 

Range  tracking  error 

Indication  of  blanking  of  the  display  on  any  input 
channel 

Discrete  data: 

Radar  configuration 
circular  scan 
fast  circular  scan 
sector  scan 

Sight  configuration 

2x  magnification,  clear  filter 
2x  magnification,  neutral  density  filter 
2x  magnification,  orange  filter 


t . 


1 . 


52 


(5x  magnil'ication,  clear  filter 

<>x  magnification,  neutral  density  filter 

fix  magnification,  orange  filter 

Angle  control  configuration 

Azimuth  rate,  elevation  rate 
Azimuth  position,  elevation  position 
Azimuth  position,  elevation  rate 
Azimuth  rate,  elevation  position 

Range  control  configuration 
Coarse 
Fine 

Mode  of  operation 
Mode  1 
Mode  2 

Tracking  mode 
Manual 
Automatic 
Search 

Angle  operator  input  channel 

Optical  (viewing  through  the  sight) 

Radar  (not  viewing  through  the  sight) 

These  data  will  be  recorded  as  time  series  for  purposes  of  analyzing 
discrete  control  performance  and  providing  feedback  to  the  trackers. 
Data  tapes  will  contain  all  tracking  data  and  discrete  data  recorded 
at  a rate  of  at  least  10  Hz. 

Feedback  for  the  trackers  is  displayed  on  the  auxiliary  CRT  after 
each  trajectory  is  run.  The  displayed  information  includes: 

Team  number 

Run  number 

Total  time  out  of  auto  track 

In  planning  the  experimental  treatments  the  following  resources  and 
guidelines  were  considered: 

20  workdays  maximum 

6 teams  of  2 trackers  each 
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10  trajectories 


M-(i  teams  per  day 

20  runs  per  team  per  day 

1 tracking  session  per  team  per  day 

at  least  20  replication  per  trajectory  per  team 

The  application  of  experimental  treatments  involves  the  following  rules; 

a.  Each  team  will  track  each  of  the  ten  trajectories  twice  during  a 
given  session. 

b.  The  order  of  presentation  of  trajectories  during  a session  will 
be  randomized. 

c.  Over  the  course  of  the  experiment  each  trajectory  will  be  tracked 
20  times. 

d.  Seven  runs  with  each  trajectory  will  involve  a perturbation  of  the 
range  signal  forcing  the  target  out  of  the  range  gate  with  simultan- 
eous opening  of  the  auto  track  loop.  The  angle  displays  are  not 
otherwise  disturbed. 

e.  Seven  runs  with  each  trajectory  will  involve  disruption  of  the  angle 
displays  and  opening  of  the  auto  track  loop.  If  the  system  is  in 
mode  1,  the  radar  screen  will  be  saturated.  If  the  system  is  in 
mode  2,  the  optical  display  will  be  blanked. 

f.  The  remaining  trajectories  will  not  be  perturbed. 

g.  Introduction  of  disturbances  will  be  randomized  over  the  20  runs. 

h.  Duration  of  the  disturbance  will  be  random  (uniformly  distributed) 
over  the  interval  4 seconds  to  10  seconds  or  the  end  of  the  run 
whichever  comes  first. 

i.  The  point  of  introduction  of  a disturbance  will  be  random  over  the 
interval  5 to  15  seconds  after  acquisition  of  auto  track,  but  never 
within  10  seconds  of  the  end  of  a run. 

j.  If  auto  track  is  not  achieved,  or  is  not  achieved  in  sufficient  time, 
on  a trajectory  which  was  to  be  perturbed,  the  trajectory  will  be 
repeated  if  at  all  possible. 


A total  of  1200-2400  total  runs  will  be  available  from  the  experiment. 
During  the  course  of  the  experiment  and  training,  progress  will  be  moni- 
tored to  determine  if  tradeoffs  are  warranted  in  the  number  of  sessions, 
trajectories,  replications  and  procedures  of  disturbance  introduction. 

4.  Procedures 

Standard  warm  up  procedures  will  be  followed. 

The  sector  into  which  the  target  will  be  Introduced  will  be  communicated 
to  the  angle  operator.  Sector  widths  of  approximately  45  degrees  will  be 
used.  The  initial  mode  setting  will  also  be  communicated  to  him  at  this 
time.  Mode  1 and  mode  2 settings  will  be  randomly  generated.  The 
angle  operator  will  signal  that  the  team  is  ready  by  depressing  a foot  s 
switch.  The  target  will  then  appear  in  the  predetermined  sector  after  a 
random  delay  of  4 to  10  seconds.  After  each  run  feedback  to  the  team 
will  be  displayed  on  the  auxiliary  CRT  and  short  rest  will  be  given.  The 
procedure  will  then  be  repeated  for  the  next  trajectory.  Whenever  feas- 
ible, runs  in  which  a disturbance  was  planned  and  in  which  auto  track 
was  not  achieved  will  be  repeated  to  obtain  the  planned  number  of 
replications. 


At  the  completion  of  each  session,  the  team  will  be  given  the  opportunity 
— to  make  comments  regarding  strategy  or  other  noteworthy  apsects  of 
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TABLE  1.  CHARACTERISTICS  OF  TRAJECTORIES 


'I'ablo  1 


Indicator  # 

Value 

h'nablinf;  Condition 

1 

1 

Optical  data  and  left  site  configuration 

0 

Otherwise 

2 

1 

System  in  mode  4 operation 

0 

Otherwise 

3 

1 

Radar  data  to  angle  operator 

0 

Otherwise 

4 

1 

All  nontracking  activity  states 

0 

Tracking  states 

5 

1 

Az  control  in  position  configuration 

0 

Otherwise 

6 

1 

El  control  in  position  configuration 

0 

El  control  in  rate  configuration 

7 

1 

Manual  track  or  (auto  track  and  mode  2)  of  mode  4 

0 

Otherwise 

8 

1 

Mode  1 and  auto  track 

0 

Otherwise 

9 

1 

Radar  in  circular  scan  mode 

0 

Otherwise 

10 

1 

Radar  in  fast  circular  scan  mode 

0 

Otherwise 

11 

1 

Radar  in  sector  search  mode 

0 

Otherwise 

12 

1 

Range  control  set  to  coarse 

0 

Range  control  set  to  fine 

13 

1 

Auto  track 

0 

Otherwise 

14 

Not  used 

Table  1 (Continued) 


Indicator  # 

Value 

Enabling  Condition 

15 

0 

Reflex  site  slaved  to  antenna — system  overridden 
by  the  commander 

1 

Otherwise 

16 

1 

Fire  control  with  angle  operator 

0 

Fire  control  with  commander 

17 

1 

Gunner's  coolant  switch  depressed 

0 

Otherwise 

18 

1 

Gunner's  trigger  depressed 

0 

Otherwise 

19 

1 

Commander's  coolant  switch  depressed 

0 

Otherwise 

20 

1 

Commander's  trigger  depressed 

0 

Otherwise 

21 

1 

Interlock  system  shunted 

0 

Otherwise 

22 

1 

Upper  guns  activated 

0 

Upper  guns  not  activated 

23 

1 

Lower  guns  activated 

0 

Lower  guns  not  activated 

24 

1 

Commander  viewing  through  reflex  site 

0 

Otherwise 

25 

1 

Commander  viewing  scene  directly 

0 

Otherwise 
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Table  2 


Unit  of  Description  States  Controlled  by* 


Major  system  function 

search 

acquire 

track 

fire 

1.3 

System  mode 

1 

3 

2 

3 

4 

Computer  input  channel 

reflex  site 
antenna  and  site 

3 

Commander  info 

reflex  site 

3 

channel 

direct  observation 
computer  output  displays 

Angle  information 

optical 

1 

channel 

radar 

Tracking  mode 

manual 

auto 

1 

Firing  configuration 

angle  operator 
commander 

3 

Gun  configuration 

upper  only 
lower  only 
both 

3 

Interlock 

shunted 

not  shunted 

3 

Radar 

circular  scan 
fast  circular  scan 

sector  scan 

1 

Az  tracking  control 

rate 

position 

1 

El  tracking  control 

rate 

position 

1 

Range  tracking  control 

coarse 

fine 

2 

Left  sight 

see  Figure  10 

1 

Ri^t  site 

see  Figure  11 

1 

* 1 denotes  angle  operator 

2 denotes  range  operator 

3 denotes  commander 
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Table  3 


Firing  Policy  Status; 

Local  Cumulative  States:  ' | 

State  1 — Total  less  than  max  allowed*  1*  j 

State  2 — Total  greater  than  max  . | 

" ■ ? I 

I ' 

Burst  States:  i • ' 

State  1 short  3-10  rds 

State  2 long  10-20  rds 

State  3 cont  20-50  rds  *• 

Cooling  States: 

State  1 — short  0.5-1  sec  I 

State  2 — inter  2-3  sec  __ 

State  3 — major  10-15  sec 


4 I 

♦The  maximum  is  120-150  rds. 


Firing  States:  Defined  from  cumulative  states  and  burst  states 

State  (1, 1)  Total  less  than  max  and  short  burst 
State  (1,  2)  Total  less  than  max  and  long  burst 

State  (1,  3)  Total  less  than  max  and  cont  burst 

State  (2, 1)  Total  greater  than  max  and  short  burst 

State  (2,  3)  Total  greater  than  max  and  cont  burst 


r 


Variable 

Table  4 

Input  Variable  Definitions 

Symbol 

Range 

R 

Azimuth  Error 

AE 

Elevation  Error 

EE 

Azimuth  Error  Rate 

AER 

Elevation  Error  Rate 

EER 

Range  Error 

RE 

Channel  Status 

CS 

Table  5 

[ 

I 

Random  Variable  Definitions 

Definition  Properties 

X_;  R -»  {0,  1 } ^ Rmax 

U r ^ Rmax 

X^:  AExEExAERxEER  -»  {0, 1 } X^(a,f3,  y.  6)  = 0 j a^a^  + agP^  + agy^  + a^S^  < 1 

1 / otherwise 

Xj^j,:  RE -4  { 0, 1 } Xj^(a)  =i0  a < rmax 

( 1 otherwise 

X(,g:  CS  -*  {0, 1,  2 } X ( a ) = < 0 both  channels  OK 

I 1 radar  down 
' 2 optics  down 
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APPENDIX  6 


FIGURES  REFERRED  TO  IN  TEXT 
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Tracking  ^stem 


RADAR  OPTICAL 


CIRCULAR  CIRCULAR  SECTOR  CIRCULAR  CIRCULAR  SECTOR 

SCAN  SCAN  SCAN  SCAN  SCAN  SCAN 


ACQUIRE 


CAPTAIN  OPTICAL  RADAR 


MANUAL  SCAN  MANUAL  SCAN 


Figure  4.  — Angle  Operator  State  Trees — 
Search  and  Acquire  Modes 
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I 


SKAUCll 


ACQUIRE 


OBSERVATION  ACTIVE 


Figure  6.  — Commander  State  Trees — 

Search  and  Acquire  Modes  j i 

} 1 


] 

i 
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FIRE  MODE  4 


COMMANDER  ANGLE  OPERATOR 


Commander  State  Tree  - Mode  4 Firing 


FIRE 


MODE  1 MODE  2 MODE  4 


OPTICAL  RADAR  OPTICAL  RADAR 


Angle  Operator  State  Tree — All  Firing  Modes 


Figure  9 
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OPTICS  DOWN  OPTICS  OK 


ANGLES  ANGLES 

OUT  OF  OUT  OF 

BOUNDS  BOUNDS 


Figure  13.  — Input  Determinators 


Determine  Major  State  and 
Diput  and  Output  ^mbols 


No  & Output  Sam  e^  Yes 

^^as  Last  Sten,>^ 


Storage 
, tape  ^ 


'Write  Old  Input, 
Output  & Major 
State  ^mbols 
& Time-In-State , 


Re-Initialize 

Time-In-State 

Counter 


Increment 

Time-In-State 

Counter 


'^End\^ 

,of  Run^ 
lYes 


Write 

Metrics 

Record 


STOP 


Figure  14.  — Pre-Processing  Flow  Chart 


Figure  14.  — Count  Flow  Chart 
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Get  Options:  Which  Teams  & 
Trajectories  to  be  Combined, 
and  Value  (Input) 


Figure  16.  — Parameter  Estimation  Routine 
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Table  6 


Input  Definitions 


Input  Number 

Definition 

1 

Target  has  not  appeared  or  range  > 20, 000  ft. 

2 

Optics  and  radar  blanked 

3 

Radar  blanked  and  az/el  errors  out  of  bounds* 

4 

Radar  blanked  and  az/el  and  range  errors  in 
bounds 

5 

Radar  blanked,  az/el  errors  in  bounds,  range 

errors  out  of  bounds 

i.  6 

Radar  not  blanked,  az/el  errors  out  of  bounds 

' ■ 7 

Radar  not  blanked,  az/el  and  range  errors 
in  bounds 

8 

Radar  not  blanked,  az/el  errors  in  boimds, 
range  out  of  bounds 

* Bounds  for  errors: 

I az  error  | - 1120  units  = 6. 3° 

I el  error  | ^ 80  units  = 2.0° 

1 range  error  1 - 76  units  = 2432  feet 
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Table  7 


Operational  Definitions  of  Major  States 

Major  State 


Number 

Descriptor 

Enabling  Condition 

1 

Search 

Circular  or  sector  search 
switches  set 

2 

Acquire 

Manual  control  with  az/ el  or  . 

range  errors  out  of  bounds 

3 

Track 

Auto  track  switch  set  or  manual  | 

control  with  all  errors  in 
boimds  - 

■ " ■ ■ i 

1.  } 


i , 

i 

^ I 


L 

! 


P 


Table  8 


Operational  Definition  of  System  Activity  States 


Major  State 
Number 

State 

Number 

Description 

1 

1 

S earch  state,  optics  in  use 

1 

2 

Search  state,  radar  in  use 

2 

1 

Acquire  state,  optics  in  use 

2 

2 

Acquire  state,  radar  in  use 

3 

1 

Track  state,  mode  1, 

manual  control,  radar  display 

3 

2 

Track  state,  mode  1, 

manual  control,  optics  display 

3 

3 

T rack  state,  mode  1, 

auto  control,  radar  display 

3 

4 

Track  state,  mode  1, 

auto  control,  optics  display 

3 

5 

Track  state,  mode  2, 

manual  control,  radar  display 

3 

6 

Track  state,  mode  2, 

manual  control,  optics  display 

3 

7 

Track  state,  mode  2, 

auto  control,  radar  display 

3 

8 

Track  state,  mode  2, 

auto  control,  optics  display 

Table  9 


"1 


I Summary  of  biput  and  State  Occurrences 

^ Input  Number  of  Occurrences 


1 

665 

2 

37 

3 

388 

4 

616 

5 

852 

6 

975 

7 

3314 

8 

2741 

Maior  State 

State 

Number  of  Occurrences 

1 

1 

4 

i , 

1 

2 

1394 

I • 

2 

1 

704 

* • 

2 

2 

1290 

— • 

i. 

3 

1 

526 

/ 

J 

3 

2 

514 

it*,  r ' 

3 

3 

4229 

i. 

3 

4 

661 

3 

5 

96 

r • 

3 

6 

0 

3 

7 

158 

3 

8 

12 

Table  10 


Number  of  State  Occupancies  and  Transitions 
All  Teams/ A 11  Trajectories 

Major  Number  times  Number  transitions 


State 

Input 

State 

state  occupied 

from  state 

1 

1 

1 

2 

2 

1 

1 

2 

508 

2 

1 

2 

1 

0 

0 

1 

2 

2 

0 

0 

1 

3 

1 

0 

0 

1 

3 

2 

0 

0 

1 

4 

1 

0 

0 

1 

4 

2 

0 

0 

1 

5 

1 

0 

0 

1 

5 

2 

0 

0 

1 

6 

1 

2 

1 

1 

6 

2 

482 

2 

1 

7 

1 

0 

0 

1 

7 

2 

181 

0 

1 

8 

1 

0 

0 

1 

8 

2 

221 

0 

2 

1 

1 

0 

0 

2 

1 

2 

114 

0 

2 

2 

1 

11 

4 

2 

2 

2 

5 

3 

2 

3 

1 

171 

7 

2 

3 

2 

191 

117 

2 

4 

1 

0 

0 

2 

4 

2 

0 

0 

2 

5 

1 

242 

9 

2 

5 

2 

292 

72 

2 

6 

1 

56 

1 

2 

6 

2 

338 

18 

2 

7 

1 

0 

0 

2 

7 

2 

0 

0 

2 

8 

1 

224 

9 

2 

8 

2 

350 

24 

3 

1 

1 

21 

0 

3 

1 

2 

0 

0 

3 

1 

3 

0 

0 

3 

1 

4 

0 

0 

3 

1 

5 

20 

4 
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9^2 

AOA 

053017 

a 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

■ 

■ 

1 

1 

1 

1 

1 

1 

END 

OATt 

FUMED 

5 78 

DOT 

Table  10  (continued) 


Major 

State 

biput 

State 

Number  times 
state  occupied 

Number  transitions 
from  state 

3 

1 

6 

0 

0 

3 

1 

7 

0 

0 

3 

1 

8 

0 

0 

3 

2 

1 

0 

0 

3 

2 

2 

7 

2 

3 

2 

3 

6 

0 

3 

2 

4 

8 

7 

3 

2 

5 

0 

0 

3 

2 

6 

0 

0 

3 

2 

7 

0 

0 

3 

2 

8 

0 

0 

3 

3 

1 

0 

0 

3 

3 

2 

0 

0 

3 

3 

3 

5 

0 

3 

3 

4 

15 

0 

3 

3 

5 

0 

0 

3 

3 

6 

0 

0 

3 

3 

7 

3 

1 

3 

3 

8 

1 

1 

3 

4 

1 

168 

57 

3 

4 

2 

240 

30 

3 

4 

3 

167 

91 

3 

4 

4 

40 

21 

3 

4 

5 

0 

0 

3 

4 

6 

0 

0 

3 

4 

7 

1 

0 

3 

4 

8 

0 

0 

3 

5 

1 

0 

0 

3 

5 

2 

0 

0 

3 

5 

3 

285 

28 

3 

5 

4 

33 

4 

3 

5 

5 

0 

0 

3 

5 

6 

0 

0 

3 

5 

7 

0 

0 

3 

5 

8 

0 

0 

3 

6 

1 

0 

0 

3 

6 

2 

0 

0 

3 

6 

3 

64 

5 

3 

6 

4 

15 

1 

3 

6 

5 

0 

0 

3 

6 

6 

0 

0 

3 

6 

7 

16 

7 

3 

6 

8 

2 

0 
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Table  10  (Continued) 


Table  11 

1 < 


Transition  Probabilities 

Aggregated  Data  - All  Teams,  All  Trajectories  1 * 


Number  of 
Occupancies 

Number  of 
Transitions 

i 

1. 

r 0 

1" 

11 

4 

T-  • 

P(2,2)*  = 

Li 

0. 

5 

3 

i. 

■ 0 

1" 

171 

7 

i: 

P(2.3)  = 

_ 1 

0 

191 

117 

"0 

1' 

242 

9 

f 

• * 

P(2. 5)  - 

1 

0 

292 

72 

1 

i. 

•0 

in 

56 

1 

--r 

P(2, 6)  = 

1 

0. 

338 

18 

1. 

Table  11  (Continued) 

Number  of 

Number  of 

Occupancies 

Transitions 

0 

0 

0 

0 

0 

0 

0 

0 

21 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

P(3.1)  = 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

0 

0 

0 

0 

0 

0 

20 

4 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

_ 0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

0 

0 

0 

7 

2 

0 

0 

0 

0 

0 

0 

0 

0 

6 

0 

P(3.  2)  = 

0 

.14 

.86 

0 

0 

0 

0 

0 

8 

7 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

5 

0 

P(3,  3)  = 

0 

0 

0 

0 

0 

0 

0 

0 

15 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

3 

1 

0 

0 

0 

0 

0 

0 

1 

0 

1 

1 

0 

.84 

.16 

0 

0 

0 

0 

0 

168 

57 

.67 

0 

0 

.33 

0 

0 

0 

0 

240 

30 

.77 

0 

0 

.23 

0 

0 

0 

0 

167 

91 

P(3,4)  = 

0 

0 

.76 

0 

.24 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

40 

0 

21 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

91 

I 

! 
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Table  11  (Continued) 


Number  of  Number  of 
Occupancies  Transitions 


Time  in  State  Summary 


Major 

State 

Input 

State 

Sample 

Size 

Average 
Time  (sec) 

Varianet 

(sec^) 

1 

1 

1 

2 

1.10 

.02 

1 

1 

2 

2 

1.10 

.02 

1 

6 

1 

1 

6. 37 

— 

1 

6 

2 

1 

6.37 

— 

2 

2 

1 

4 

.71 

.11 

2 

2 

2 

3 

.69 

.15 

2 

3 

1 

7 

.78 

.49 

2 

3 

2 

117 

.63 

.16 

2 

5 

1 

9 

.86 

.37 

2 

5 

2 

72 

.70 

.40 

2 

6 

1 

1 

.63 

— 

2 

r> 

2 

18 

.59 

. 14 

2 

8 

1 

9 

1.  10 

1.16 

2 

8 

2 

24 

1.03 

.79 

3 

1 

5 

4 

.81 

.22 

3 

2 

2 

2 

.13 

.01 

3 

2 

4 

7 

.58 

.10 

3 

3 

7 

1 

3.63 

— 

3 

3 

8 

1 

3.63 

3 

4 

1 

57 

1.42 

2.32 

3 

4 

2 

30 

1.55 

1.94 

3 

4 

3 

91 

.70 

.34 

3 

4 

4 

21 

1.  20 

.75 

3 

5 

3 

28 

1.06 

.34 

3 

5 

4 

4 

.63 

..16 

3 

6 

3 

5 

• 

00 

00 

.40 

3 

6 

4 

1 

.37 

— 

3 

6 

7 

7 

1.45 

4.54 

3 

7 

1 

267 

.46 

.34 

3 

7 

2 

211 

.62 

.45 

3 

7 

3 

111 

2.53 

23.81 

3 

7 

4 

314 

.96 

3.57 

3 

7 

5 

56 

.34 

.12 

3 

7 

7 

61 

.65 

.45 

3 

8 

3 

84 

3. 57 

16. 48 

3 

8 

4 

129 

1.48 

2.82 

3 

8 

7 

26 

.52 

.25 

3 

8 

8 

1 

.73 

93 
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I 


Tiiblc  i;j 

Transition  Probal)iIitie8  and  Time  in  State 
with  Inputs  7 and  8 Combined 

0 .03  .97  0 0 

. 04  0 0 . 9fi  0 

.Of)  0 0 .95  0 

1>(3  7)  - ® ® 

’ . 04  0 0 0 0 

0 0 0 0 0 

0 0 . 99  0 0 

0 0 0 0 0 


state 

Average  Time 

Variance 

t 

1 

1 

.46 

.77 

i 

i. 

2 

.62 

1.21 

3 

2.  98 

38.  62 

1 ; 

4 

1.11 

5.88 

' ! 

5 

.34 

.34 

6 

0 

0 

1 * 

7 

.61 

1.13 

I 

8 

.73 

1.08 

r ■ 

0 0 0 
0 0 0 
0 0 0 
0 0 0 
0 .90  0 

0 0 0 
0 0 .01 
0 10 


Table  14 


P(3,4) 


Team  1 - All  Trajectories 


0 .71  .29  0 0 0 0 0 

00000000 
.64  0 0 .36  0 0 0 0 

0 .5  .5  0 0 0 0 0 

00000000 
00000000 
00000000 
00000000 


Number  of 
Occupancies 

30 

75 

29 

11 

0 

0 

0 

0 


Number  of 
Transitions 

7 

3 

14 

2 

0 

0 

0 

0 


P(3,  7) 


" 0 . 04  . 96  0 

0 0 0 1 

.10  0 0 .9 

0 0 10 

. 03  0 0 0 

0 0 0 0 

0 0 10 

0 0 0 0 


0 0 0 o' 
0 0 0 0 
0 0 0 0 
0 0 0 0 
0 0 . 97  0 
0 0 0 0 
0 0 0 0 
0 0 0 0 


64 

46 

93 

62 

457 

41 

128 

92 

44 

30 

0 

0 

57 

31 

0 

0 

P(3,8) 


0 0 0 0 
0 0 0 0 
0 0 0 1 
0 0 10 
0 0 0 0 
0 0 0 0 
0 0 10 
0 0 0 0 


0 

0 

0 

0 

0 

0 

0 

0 


0 0 
0 0 
0 0 
0 0 
0 0 
0 0 
0 0 
0 0 


0 

0 

0 

0 

0 

0 

0 

0 


0 

0 

411 

83 

0 

0 

26 

0 


0 

0 

36 

55 

0 

0 

19 

0 


95 


r 


P(3,4) 


P(3,7)  ^ 


P(3,8) 


Table  15 


Team  2 - All  Trajectories 


± c;cii 

1 ^ 

Number  of 

Number  of 

Occupancies 

Transitions 

‘ 0 

.73 

.27 

0 

0 

0 

0 

oi 

48 

22 

0 

0 

0 

1 

0 

0 

0 

0 

82 

3 

.60 

0 

0 

.40 

0 

0 

0 

0 

70 

40 

0 

.94 

.06 

0 

0 

0 

0 

0 

23 

16 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

00 

0 

'o 

0 

1 

0 

0 

0 

0 

o' 

69 

51 

0 

0 

0 

1 

0 

0 

0 

0 

70 

59 

0 

0 

0 

1 

0 

0 

0 

0 

404 

19 

0 

.01 

.99 

0 

0 

0 

0 

0 

92 

84 

0 

0 

0 

0 

0 

0 

1 

0 

4 

3 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

0 

0 

0 

0 

3 

2 

_0 

0 

0 

0 

0 

0 

0 

0 

"0 

0 

0 

0 

0 

0 

0 

0 ■ 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

0 

0 

0 

317 

10 

0 

0 

1 

0 

0 

0 

0 

0 

32 

23 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

.0 

0 

0 

0 

0 

0 

0 

0 . 

0 

0 

96 
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Table  IG 


Team  3 - All  Trajectories 

Number  of  Number  of 
Occupancies  Transitions 

■ 0 1 0 0 0 0 0 O"!  62  21 

.89  0 0 .11  0 0 0 0 61  19 

10000000  32  19 

P(3.4)=  0 0 1 0 0 0 0 0 2 1 

' ' 00000000  0 0 
00000000  0 0 

00000000  0 0 

00000000  0 0 


T:iblc'  17 


P(3.  4) 


P(3,7) 


P(3,8) 


Team  4 

- All 

Trajectories 

Number  of 

Occupancies 

' 0 

.86 

.14 

0 

0 

0 

0 

0 ' 

28 

.60 

0 

0 

.40 

0 

0 

0 

0 

22 

1 

0 

0 

0 

0 

0 

0 

0 

36 

0 

0 

1 

0 

0 

0 

0 

0 

4 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

_ 0 

0 

0 

0 

0 

0 

0 

0 

0 

" 0 

.03 

.97 

0 

0 

0 

0 

o' 

128 

.13 

0 

0 

00 

• 

0 

0 

0 

0 

53 

. 13 

0 

0 

.87 

0 

0 

0 

0 

569 

0 

0 

1 

0 

0 

0 

0 

0 

79 

1 

0 

0 

0 

0 

0 

0 

0 

3 

0 

0 

0 

0 

0 

0 

0 

0 

0 

00 

0 

.5 

0 

0 

0 

0 

.5 

3 

0 

0 

0 

0 

0 

0 

0 

0_ 

4 

1 

’ 0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

0 

0 

0 

0 

503 

0 

0 

1 

0 

0 

0 

0 

0 

34 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 

_ 0 

0 

0 

0 

0 

0 

1 

0_ 

5 

Number  of 
Transitions 

7 

5 

18 

2 

0 

0 

0 

0 


98 

45 

32 

72 

1 

0 

2 

0 


0 

0 

26 

29 

0 

0 

0 

1 
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Table  19 


P(3,4) 


P(3,7) 


P(3,  8) 


Trajectory  Number  2 


0 1 0 0 0 0 0 

0 0 0 1 0 0 0 

0 0 0 1 0 0 0 

0 .5  0 .5  0 0 0 

0 0 0 0 0 0 0 

0 0 0 0 0 0 0 

0 0 0 0 0 0 0 

0 0 0 0 0 0 0 


0 0 1 0 0 0 0 

.04  0 0 .96  0 0 0 

0 0 0 1 0 0 0 

0 0 1 0 0 0 0 

.17  0 0 0 0 0 .83 

0 0 0 0 0 0 0 

0 0 1 0 0 0 0 

0 0 0 0 0 0 0 


0 0 0 0 
0 0 0 0 
0 0 0 1 
0 0 10 
0 0 0 0 
0 0 0 0 
0 0 10 
0 0 0 0 


0 0 0 
0 0 0 
0 0 0 
0 0 0 
0 0 0 
0 0 0 
0 0 0 
0 0 0 


- All  Teams 


0 

0 

0 

0 

0 

0 

0 

0 


0 

0 

0 

0 

0 

0 

0 

0 


0 

0 

0 

0 

0 

0 

0 

0 


Number  of 
Occupancies 

2 

18 

15 

4 

0 

0 

0 

0 


36 

36 

271 

46 

8 

0 

12 

0 


0 

0 

205 

15 

0 

0 

11 

0 


Number  of 
Transitions 

1 

1 

3 

2 

0 

0 

0 

0 


26 

27 

11 

41 

6 

0 

3 

0 


0 

0 

3 

12 

0 

0 

7 

0 
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Table  20 


P(3,4) 


P(3.7) 


P(3.8) 


Trajectory  Number  4 


0 .91  .09  0 0 0 0 

.75  0 0 .25  0 0 0 

.75  0 0 .25  0 0 0 

0 .67  .33  0 0 0 0 

0 0 0 0 0 0 0 

0 0 0 0 0 0 0 

0 0 0 0 0 0 0 

0 0 0 0 0 0 0 


0 .11  .89  0 0 0 0 

. 04  0 0 . 96  0 0 0 

.08  0 0 .92  0 0 0 

0 0 0 1 0 0 0 

0 0 0 0 0 0 1 

0 0 0 0 0 0 0 

0 0 1 0 0 0 0 

0 0 0 0 0 0 0 


0 0 0 0 0 0 0 
0 0 0 0 0 0 0 
0 0 0 1 0 0 0 
0 0 1 0 0 0 0 
0 0 0 0 0 0 0 
0 0 0 0 0 0 0 
0 0 1 0 0 0 0 
0 0 0 0 0 0 0 


All  Teams 


0 

0 

0 

0 

0 

0 

0 

0 


0 

0 

0 

0 

0 

0 

0 

0. 


0 

0 

0 

0 

0 

0 

0 

0 


Number  of 
Occupancies 

17 

29 

15 

5 

0 

0 

0 

0 


36 

32 

222 

59 

9 

0 

11 

0 


0 

0 

189 

44 

0 

0 

3 

0 


Number  of 
Transitions 

11 

4 

8 

3 

0 

0 

0 

0 


28 

26 

13 

41 

6 

0 

8 

0 


0 

0 

18 

23 

0 

0 

3 

0 
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Table  21 


Trajectory  Number  7 - All  Teams 


Number  of  Number  of 
Occupancies  Transitions 


Table  22 


: 


Trajectory  Number  8 - All  Teams 


Number  of  Number  of 
Occupancies  Transitions 


P(3,4) 


0 .78  .22  0 

.33  0 0 .67 

. 83  0 0 . 17 

0 .50  0 .50 

0 0 0 0 

0 0 0 0 

0 0 0 0 

0 0 0 0 


0 0 0 0' 

0 0 0 0 

0 0 0 0 

0 0 0 0 

0 0 0 0 

0 0 0 0 

0 0 0 0 

0 0 0 0 


30 

30 

16 

5 

0 

0 

1 

0 


9 

3 

6 

2 

0 

0 

0 

0 


P(3,7) 


0 0 
0 0 
0 0 
0 0 
0 0 
0 0 
0 0 
0 0 


1 0 
0 1 
0 1 
1 0 
0 0 
0 0 
.93  0 
0 0 


0 0 
0 0 
0 0 
0 0 
0 0 
0 0 
0 0 
0 0 


0 0 
0 0 
0 0 
0 0 
1 0 
0 0 
0 .07 
0 0 


67 

22 

354 

36 

19 

0 

23 

4 


51 

14 

14 
27 
13 

0 

15 
0 


P(3,8)  - 


0 

0 

0 

0 

0 

0 

0 

0 


0 

0 

0 

0 

0 

0 

0 

0 


0 0 0 
0 0 0 
0 10 
10  0 
0 0 0 
0 0 0 
10  0 
0 0 0 


0 0 0 
0 0 0 
0 0 0 
0 0 0 
0 0 0 
0 0 0 
0 0 0 
0 10 


0 

0 

365 

54 

0 

0 

7 

5 


0 

0 

27 

47 

0 

0 

2 

1 
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Tabic  23 


Table  24 


Number  of 
Transitions 

12 

4 

26 

3 

0 

0 

0 

0 


52 

40 

20 

52 

9 

0 

8 

0 


